Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 602998 Details for
Bug 843058
Can't run large amount of VMs simultaneously. Getting error Cant find VDS to run the VM.
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
engine debug log
engine.log (text/x-log), 5.12 MB, created by
Roy Golan
on 2012-08-08 11:22:38 UTC
(
hide
)
Description:
engine debug log
Filename:
MIME Type:
Creator:
Roy Golan
Created:
2012-08-08 11:22:38 UTC
Size:
5.12 MB
patch
obsolete
>2012-08-05 13:09:53,595 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) Start time: 8/5/12 1:09 PM >2012-08-05 13:09:53,799 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: CbcCheckOnVdsChange >2012-08-05 13:09:53,822 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: CAEngineKey >2012-08-05 13:09:53,825 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: ENGINEEARLib >2012-08-05 13:09:53,863 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: MinimalETLVersion >2012-08-05 13:09:54,494 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: ScriptsPath >2012-08-05 13:09:54,495 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: SQLServerI18NPrefix >2012-08-05 13:09:54,656 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (MSC service thread 1-1) Failed to decrypt Data must start with zero >2012-08-05 13:09:54,659 ERROR [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (MSC service thread 1-1) Failed to decrypt value for property TruststorePass will be used encrypted value >2012-08-05 13:09:54,775 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) VDSBrokerFrontend: 8/5/12 1:09 PM >2012-08-05 13:09:54,786 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) CpuFlagsManager: 8/5/12 1:09 PM >2012-08-05 13:09:54,787 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-1) Setting audit clean up manager to run at: 35 35 3 * * ? >2012-08-05 13:09:54,849 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) AuditLogCleanupManager: 8/5/12 1:09 PM >2012-08-05 13:09:54,859 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-1) TagsDirector initialization >2012-08-05 13:09:54,919 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-1) Tag root added to tree >2012-08-05 13:09:54,947 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) TagsDirector: 8/5/12 1:09 PM >2012-08-05 13:09:54,970 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) IsoDomainListSyncronizer: 8/5/12 1:09 PM >2012-08-05 13:09:55,041 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) InitHandlers: 8/5/12 1:09 PM >2012-08-05 13:09:55,071 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-1) Code VDS_FENCING_OPERATION_FAILED appears more then once in string table. >2012-08-05 13:09:55,073 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) ErrorTranslator: 8/5/12 1:09 PM >2012-08-05 13:09:55,077 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) VdsErrorTranslator: 8/5/12 1:09 PM >2012-08-05 13:09:55,078 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) Mark uncompleted jobs as UNKNOWN: 8/5/12 1:09 PM >2012-08-05 13:09:55,198 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) JobRepositoryCleanupManager: 8/5/12 1:09 PM >2012-08-05 13:09:55,205 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) AutoRecoveryManager: 8/5/12 1:09 PM >2012-08-05 13:09:55,219 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) ExecutionMessageDirector: 8/5/12 1:09 PM >2012-08-05 13:09:55,301 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (MSC service thread 1-2) UsersDomainsCacheManager: 8/5/12 1:09 PM >2012-08-05 13:09:55,315 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-1) InitResourceManager: 8/5/12 1:09 PM >2012-08-05 13:09:55,335 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-1) ResourceManager::ResourceManager::Entered >2012-08-05 13:09:55,477 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (MSC service thread 1-2) DbUserCacheManager: 8/5/12 1:09 PM >2012-08-05 13:09:55,543 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-1) DbUserCacheManager::refreshAllUserData() - entered >2012-08-05 13:09:55,943 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (MSC service thread 1-1) AsyncTaskManager: Initialization of AsyncTaskManager completed successfully. >2012-08-05 13:09:55,946 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-1) AsyncTaskManager: 8/5/12 1:09 PM >2012-08-05 13:09:55,951 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-1) VdsLoadBalancer: 8/5/12 1:09 PM >2012-08-05 13:09:55,967 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (pool-3-thread-1) MacPoolManager started: 8/5/12 1:09 PM >2012-08-05 13:09:56,019 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (pool-3-thread-1) MacPoolManager finished: 8/5/12 1:09 PM >2012-08-05 13:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Checking autorecoverable hosts >2012-08-05 13:10:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Autorecovering 0 hosts >2012-08-05 13:10:00,029 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Checking autorecoverable hosts done >2012-08-05 13:10:00,038 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Checking autorecoverable storage domains >2012-08-05 13:10:00,058 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Autorecovering 0 storage domains >2012-08-05 13:10:00,059 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Checking autorecoverable storage domains done >2012-08-05 13:13:33,312 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-4) Checking if user admin@internal is an admin, result true >2012-08-05 13:13:33,321 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-4) Running command: LoginAdminUserCommand internal: false. >2012-08-05 13:13:33,438 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8009-4) AuditLogType: UNASSIGNED not exist in string table >2012-08-05 13:13:33,443 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8009-4) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table >2012-08-05 13:13:33,444 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8009-4) AuditLogType: DWH_STOPPED not exist in string table >2012-08-05 13:13:33,445 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8009-4) AuditLogType: DWH_STARTED not exist in string table >2012-08-05 13:13:33,450 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8009-4) AuditLogType: DWH_ERROR not exist in string table >2012-08-05 13:13:33,460 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8009-4) AuditLogType: USER_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2012-08-05 13:13:33,461 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8009-4) AuditLogType: USER_FAILED_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2012-08-05 13:13:33,462 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8009-4) AuditLogType: USER_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2012-08-05 13:13:33,463 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8009-4) AuditLogType: USER_FAILED_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2012-08-05 13:13:35,156 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-6) Adding new value to configuration cache. >2012-08-05 13:13:35,157 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-6) Didnt find the value of DBPagingType in DB for version general - using default: Offset >2012-08-05 13:13:35,159 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-6) Adding new value to configuration cache. >2012-08-05 13:13:35,164 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-6) Didnt find the value of DBPagingSyntax in DB for version general - using default: OFFSET (%1$s -1) LIMIT %2$s >2012-08-05 13:13:35,172 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-6) Adding new value to configuration cache. >2012-08-05 13:13:35,172 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-6) Didnt find the value of DBSearchTemplate in DB for version general - using default: SELECT * FROM (%2$s) %1$s) as T1 %3$s >2012-08-05 13:13:51,963 INFO [org.ovirt.engine.core.utils.hostinstall.HostKeyVerifier] (NioProcessor-2) SSH key fingerprint 9f:73:26:bd:57:9c:94:3a:f7:29:20:49:2c:43:da:b3 for host purple-vds2 (10.35.102.54) has been successfully verified. >2012-08-05 13:13:52,036 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (ajp--127.0.0.1-8009-8) Invoking /bin/echo -e `/bin/bash -c /usr/sbin/dmidecode|/bin/awk ' /UUID/{ print $2; } ' | /usr/bin/tr ' >' '_' && /bin/cat /sys/class/net/*/address | /bin/sed -e '/00:00:00:00/d' -e '/^$/d' | /bin/sort -u | /usr/bin/head --lines=1` on purple-vds2 >2012-08-05 13:13:52,071 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (ajp--127.0.0.1-8009-8) RunSSHCommand returns true >2012-08-05 13:13:52,191 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp--127.0.0.1-8009-8) [6840243a] Running command: AddVdsCommand internal: false. Entities affected : ID: 99408929-82cf-4dc7-a532-9d998063fa95 Type: VdsGroups >2012-08-05 13:13:52,436 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp--127.0.0.1-8009-8) [54a8f9cc] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-05 13:13:52,491 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp--127.0.0.1-8009-8) [54a8f9cc] Lock freed to object EngineLock [exclusiveLocks= key: 66f96b6e-dee5-11e1-a6fd-f39cbdf23023 value: REGISTER_VDS >, sharedLocks= ] >2012-08-05 13:13:52,516 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp--127.0.0.1-8009-8) [54a8f9cc] Cannot get vdsManager for vdsid=4196a566-dee6-11e1-b66e-c35c5273fee7 >2012-08-05 13:13:52,521 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp--127.0.0.1-8009-8) [54a8f9cc] START, RemoveVdsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7), log id: 5e2bbf48 >2012-08-05 13:13:52,522 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp--127.0.0.1-8009-8) [54a8f9cc] Cannot get vdsManager for vdsid=4196a566-dee6-11e1-b66e-c35c5273fee7 >2012-08-05 13:13:52,534 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp--127.0.0.1-8009-8) [54a8f9cc] FINISH, RemoveVdsVDSCommand, log id: 5e2bbf48 >2012-08-05 13:13:52,537 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp--127.0.0.1-8009-8) [54a8f9cc] Cannot get vdsManager for vdsid=4196a566-dee6-11e1-b66e-c35c5273fee7 >2012-08-05 13:13:52,540 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp--127.0.0.1-8009-8) [54a8f9cc] START, AddVdsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7), log id: 607097bd >2012-08-05 13:13:52,541 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp--127.0.0.1-8009-8) [54a8f9cc] AddVds - entered , starting logic to add VDS 4196a566-dee6-11e1-b66e-c35c5273fee7 >2012-08-05 13:13:52,572 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp--127.0.0.1-8009-8) [54a8f9cc] AddVds - VDS 4196a566-dee6-11e1-b66e-c35c5273fee7 was added, will try to add it to the resource manager >2012-08-05 13:13:52,586 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp--127.0.0.1-8009-8) [54a8f9cc] Eneterd VdsManager:constructor >2012-08-05 13:13:52,587 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp--127.0.0.1-8009-8) [54a8f9cc] vdsBroker(purple-vds2,54,321) >2012-08-05 13:13:52,760 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp--127.0.0.1-8009-8) [54a8f9cc] ResourceManager::AddVds - VDS 4196a566-dee6-11e1-b66e-c35c5273fee7 was added to the Resource Manager >2012-08-05 13:13:52,761 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp--127.0.0.1-8009-8) [54a8f9cc] FINISH, AddVdsVDSCommand, log id: 607097bd >2012-08-05 13:13:53,018 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-3-thread-3) [68539bf8] Running command: InstallVdsCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-05 13:13:53,043 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-3-thread-3) [68539bf8] Before Installation pool-3-thread-3 >2012-08-05 13:13:53,044 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-3) [68539bf8] Installation of purple-vds2. Executing installation stage. (Stage: Starting Host installation) >2012-08-05 13:13:53,045 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-3) [68539bf8] Installation of purple-vds2. Executing installation stage. (Stage: Connecting to Host) >2012-08-05 13:13:53,078 INFO [org.ovirt.engine.core.utils.hostinstall.HostKeyVerifier] (NioProcessor-3) SSH key fingerprint 9f:73:26:bd:57:9c:94:3a:f7:29:20:49:2c:43:da:b3 for host purple-vds2 (10.35.102.54) has been successfully verified. >2012-08-05 13:13:53,151 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-3) [68539bf8] Installation of purple-vds2. Received message: <BSTRAP component='RHEV_INSTALL' status='OK' message='Connected to Host purple-vds2 with SSH key fingerprint: 9f:73:26:bd:57:9c:94:3a:f7:29:20:49:2c:43:da:b3'/>. FYI. (Stage: Connecting to Host) >2012-08-05 13:13:53,195 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-3) [68539bf8] Installation of purple-vds2. Successfully connected to server ssh. (Stage: Connecting to Host) >2012-08-05 13:13:53,196 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-3) [68539bf8] Installation of purple-vds2. Executing installation stage. (Stage: Get the unique vds id) >2012-08-05 13:13:53,197 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-3) Invoking /bin/echo -e `/bin/bash -c /usr/sbin/dmidecode|/bin/awk ' /UUID/{ print $2; } ' | /usr/bin/tr ' >' '_' && /bin/cat /sys/class/net/*/address | /bin/sed -e '/00:00:00:00/d' -e '/^$/d' | /bin/sort -u | /usr/bin/head --lines=1` on purple-vds2 >2012-08-05 13:13:53,234 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-3) [68539bf8] Installation of purple-vds2. Received message: CDE7DFEC-B187-11DE-B8CD-00215EC803C0_00:21:5e:c8:03:c0 >. FYI. (Stage: Get the unique vds id) >2012-08-05 13:13:53,238 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-3) [68539bf8] Installation of purple-vds2. Assigning unique id CDE7DFEC-B187-11DE-B8CD-00215EC803C0_00:21:5e:c8:03:c0 to Host. (Stage: Get the unique vds id) >2012-08-05 13:13:53,278 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-3) RunSSHCommand returns true >2012-08-05 13:13:53,279 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-3) [68539bf8] Installation of purple-vds2. Executing installation stage. (Stage: Upload Installation script to Host) >2012-08-05 13:13:53,280 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-3) Uploading file /usr/share/ovirt-engine/scripts/vds_installer.py to /tmp/vds_installer_0ad598f6-6d81-4719-8a25-db52fb640ec8.py on purple-vds2 >2012-08-05 13:13:53,282 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-3) Uploading file /usr/share/ovirt-engine/scripts/vds_installer.py to /tmp/vds_installer_0ad598f6-6d81-4719-8a25-db52fb640ec8.py on purple-vds2 >2012-08-05 13:13:53,825 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-3) [68539bf8] Installation of purple-vds2. successfully done sftp operation ( Stage: Upload Installation script to Host) >2012-08-05 13:13:53,826 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-3) return true >2012-08-05 13:13:53,841 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-3) Uploading file /tmp/firewall.conf2877565028203971874.tmp to /tmp/firewall.conf.0ad598f6-6d81-4719-8a25-db52fb640ec8 on purple-vds2 >2012-08-05 13:13:53,842 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-3) Uploading file /tmp/firewall.conf2877565028203971874.tmp to /tmp/firewall.conf.0ad598f6-6d81-4719-8a25-db52fb640ec8 on purple-vds2 >2012-08-05 13:13:54,102 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-3) [68539bf8] Installation of purple-vds2. successfully done sftp operation ( Stage: Upload Installation script to Host) >2012-08-05 13:13:54,103 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-3) return true >2012-08-05 13:13:54,104 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-3) [68539bf8] Installation of purple-vds2. Executing installation stage. (Stage: Running first installation script on Host) >2012-08-05 13:13:54,104 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-3) [68539bf8] Installation of purple-vds2. Sending SSH Command chmod +x /tmp/vds_installer_0ad598f6-6d81-4719-8a25-db52fb640ec8.py; /tmp/vds_installer_0ad598f6-6d81-4719-8a25-db52fb640ec8.py -c 'ssl=true;management_port=54321' -O 'qa.lab.tlv.redhat.com' -t 2012-08-05T10:13:53 -f /tmp/firewall.conf.0ad598f6-6d81-4719-8a25-db52fb640ec8 -p 80 -b http://leonid-rhevm31.qa.lab.tlv.redhat.com:80/Components/vds/ http://leonid-rhevm31.qa.lab.tlv.redhat.com:80/Components/vds/ purple-vds2 0ad598f6-6d81-4719-8a25-db52fb640ec8 False. (Stage: Running first installation script on Host) >2012-08-05 13:13:54,109 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-3) Invoking chmod +x /tmp/vds_installer_0ad598f6-6d81-4719-8a25-db52fb640ec8.py; /tmp/vds_installer_0ad598f6-6d81-4719-8a25-db52fb640ec8.py -c 'ssl=true;management_port=54321' -O 'qa.lab.tlv.redhat.com' -t 2012-08-05T10:13:53 -f /tmp/firewall.conf.0ad598f6-6d81-4719-8a25-db52fb640ec8 -p 80 -b http://leonid-rhevm31.qa.lab.tlv.redhat.com:80/Components/vds/ http://leonid-rhevm31.qa.lab.tlv.redhat.com:80/Components/vds/ purple-vds2 0ad598f6-6d81-4719-8a25-db52fb640ec8 False on purple-vds2 >2012-08-05 13:13:54,768 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-59) Initializing Host: purple-vds2 >2012-08-05 13:13:55,113 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-3) [68539bf8] Installation of purple-vds2. Received message: <BSTRAP component='INSTALLER' status='OK' message='Test platform succeeded'/> ><BSTRAP component='INSTALLER LIB' status='OK' message='deployUtil.py download succeeded'/> ><BSTRAP component='INSTALLER' status='OK' message='vds_bootstrap.py download succeeded'/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:14:00,724 INFO [org.ovirt.engine.core.utils.hostinstall.HostKeyVerifier] (NioProcessor-6) SSH key fingerprint 68:59:ac:a7:97:84:df:78:72:3d:79:53:02:fc:ee:64 for host purple-vds3 (10.35.109.10) has been successfully verified. >2012-08-05 13:14:00,864 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (ajp--127.0.0.1-8009-1) Invoking /bin/echo -e `/bin/bash -c /usr/sbin/dmidecode|/bin/awk ' /UUID/{ print $2; } ' | /usr/bin/tr ' >' '_' && /bin/cat /sys/class/net/*/address | /bin/sed -e '/00:00:00:00/d' -e '/^$/d' | /bin/sort -u | /usr/bin/head --lines=1` on purple-vds3 >2012-08-05 13:14:01,226 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (ajp--127.0.0.1-8009-1) RunSSHCommand returns true >2012-08-05 13:14:01,291 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp--127.0.0.1-8009-1) [3493d94a] Running command: AddVdsCommand internal: false. Entities affected : ID: 99408929-82cf-4dc7-a532-9d998063fa95 Type: VdsGroups >2012-08-05 13:14:01,344 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp--127.0.0.1-8009-1) [375fbc7e] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-05 13:14:01,377 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp--127.0.0.1-8009-1) [375fbc7e] Lock freed to object EngineLock [exclusiveLocks= key: 66f96b6e-dee5-11e1-a6fd-f39cbdf23023 value: REGISTER_VDS >, sharedLocks= ] >2012-08-05 13:14:01,378 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp--127.0.0.1-8009-1) [375fbc7e] Cannot get vdsManager for vdsid=47028088-dee6-11e1-bffa-2f8f15de3134 >2012-08-05 13:14:01,379 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp--127.0.0.1-8009-1) [375fbc7e] START, RemoveVdsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134), log id: 18cb7cb >2012-08-05 13:14:01,380 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp--127.0.0.1-8009-1) [375fbc7e] Cannot get vdsManager for vdsid=47028088-dee6-11e1-bffa-2f8f15de3134 >2012-08-05 13:14:01,381 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp--127.0.0.1-8009-1) [375fbc7e] FINISH, RemoveVdsVDSCommand, log id: 18cb7cb >2012-08-05 13:14:01,388 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp--127.0.0.1-8009-1) [375fbc7e] Cannot get vdsManager for vdsid=47028088-dee6-11e1-bffa-2f8f15de3134 >2012-08-05 13:14:01,389 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp--127.0.0.1-8009-1) [375fbc7e] START, AddVdsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134), log id: 2b03330e >2012-08-05 13:14:01,390 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp--127.0.0.1-8009-1) [375fbc7e] AddVds - entered , starting logic to add VDS 47028088-dee6-11e1-bffa-2f8f15de3134 >2012-08-05 13:14:01,396 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp--127.0.0.1-8009-1) [375fbc7e] AddVds - VDS 47028088-dee6-11e1-bffa-2f8f15de3134 was added, will try to add it to the resource manager >2012-08-05 13:14:01,400 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp--127.0.0.1-8009-1) [375fbc7e] Eneterd VdsManager:constructor >2012-08-05 13:14:01,401 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp--127.0.0.1-8009-1) [375fbc7e] vdsBroker(purple-vds3,54,321) >2012-08-05 13:14:01,406 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp--127.0.0.1-8009-1) [375fbc7e] ResourceManager::AddVds - VDS 47028088-dee6-11e1-bffa-2f8f15de3134 was added to the Resource Manager >2012-08-05 13:14:01,407 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp--127.0.0.1-8009-1) [375fbc7e] FINISH, AddVdsVDSCommand, log id: 2b03330e >2012-08-05 13:14:01,552 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-3-thread-4) [59e8140] Running command: InstallVdsCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-05 13:14:01,564 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-3-thread-4) [59e8140] Before Installation pool-3-thread-4 >2012-08-05 13:14:01,565 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Executing installation stage. (Stage: Starting Host installation) >2012-08-05 13:14:01,566 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Executing installation stage. (Stage: Connecting to Host) >2012-08-05 13:14:01,628 INFO [org.ovirt.engine.core.utils.hostinstall.HostKeyVerifier] (NioProcessor-7) SSH key fingerprint 68:59:ac:a7:97:84:df:78:72:3d:79:53:02:fc:ee:64 for host purple-vds3 (10.35.109.10) has been successfully verified. >2012-08-05 13:14:01,705 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Received message: <BSTRAP component='RHEV_INSTALL' status='OK' message='Connected to Host purple-vds3 with SSH key fingerprint: 68:59:ac:a7:97:84:df:78:72:3d:79:53:02:fc:ee:64'/>. FYI. (Stage: Connecting to Host) >2012-08-05 13:14:01,733 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Successfully connected to server ssh. (Stage: Connecting to Host) >2012-08-05 13:14:01,733 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Executing installation stage. (Stage: Get the unique vds id) >2012-08-05 13:14:01,734 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-4) Invoking /bin/echo -e `/bin/bash -c /usr/sbin/dmidecode|/bin/awk ' /UUID/{ print $2; } ' | /usr/bin/tr ' >' '_' && /bin/cat /sys/class/net/*/address | /bin/sed -e '/00:00:00:00/d' -e '/^$/d' | /bin/sort -u | /usr/bin/head --lines=1` on purple-vds3 >2012-08-05 13:14:01,860 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Received message: 3A1792D7-9AD9-3F7F-BCEA-D468EC51E653_00:1a:64:10:2e:18 >. FYI. (Stage: Get the unique vds id) >2012-08-05 13:14:01,865 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Assigning unique id 3A1792D7-9AD9-3F7F-BCEA-D468EC51E653_00:1a:64:10:2e:18 to Host. (Stage: Get the unique vds id) >2012-08-05 13:14:01,884 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-4) RunSSHCommand returns true >2012-08-05 13:14:01,884 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Executing installation stage. (Stage: Upload Installation script to Host) >2012-08-05 13:14:01,885 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-4) Uploading file /usr/share/ovirt-engine/scripts/vds_installer.py to /tmp/vds_installer_b38abdcb-982c-449f-af7c-dc264552fed9.py on purple-vds3 >2012-08-05 13:14:01,886 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-4) Uploading file /usr/share/ovirt-engine/scripts/vds_installer.py to /tmp/vds_installer_b38abdcb-982c-449f-af7c-dc264552fed9.py on purple-vds3 >2012-08-05 13:14:02,546 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. successfully done sftp operation ( Stage: Upload Installation script to Host) >2012-08-05 13:14:02,546 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-4) return true >2012-08-05 13:14:02,547 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-4) Uploading file /tmp/firewall.conf7284248998618712271.tmp to /tmp/firewall.conf.b38abdcb-982c-449f-af7c-dc264552fed9 on purple-vds3 >2012-08-05 13:14:02,548 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-4) Uploading file /tmp/firewall.conf7284248998618712271.tmp to /tmp/firewall.conf.b38abdcb-982c-449f-af7c-dc264552fed9 on purple-vds3 >2012-08-05 13:14:02,920 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. successfully done sftp operation ( Stage: Upload Installation script to Host) >2012-08-05 13:14:02,921 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-4) return true >2012-08-05 13:14:02,922 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Executing installation stage. (Stage: Running first installation script on Host) >2012-08-05 13:14:02,923 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Sending SSH Command chmod +x /tmp/vds_installer_b38abdcb-982c-449f-af7c-dc264552fed9.py; /tmp/vds_installer_b38abdcb-982c-449f-af7c-dc264552fed9.py -c 'ssl=true;management_port=54321' -O 'qa.lab.tlv.redhat.com' -t 2012-08-05T10:14:01 -f /tmp/firewall.conf.b38abdcb-982c-449f-af7c-dc264552fed9 -p 80 -b http://leonid-rhevm31.qa.lab.tlv.redhat.com:80/Components/vds/ http://leonid-rhevm31.qa.lab.tlv.redhat.com:80/Components/vds/ purple-vds3 b38abdcb-982c-449f-af7c-dc264552fed9 False. (Stage: Running first installation script on Host) >2012-08-05 13:14:02,927 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-4) Invoking chmod +x /tmp/vds_installer_b38abdcb-982c-449f-af7c-dc264552fed9.py; /tmp/vds_installer_b38abdcb-982c-449f-af7c-dc264552fed9.py -c 'ssl=true;management_port=54321' -O 'qa.lab.tlv.redhat.com' -t 2012-08-05T10:14:01 -f /tmp/firewall.conf.b38abdcb-982c-449f-af7c-dc264552fed9 -p 80 -b http://leonid-rhevm31.qa.lab.tlv.redhat.com:80/Components/vds/ http://leonid-rhevm31.qa.lab.tlv.redhat.com:80/Components/vds/ purple-vds3 b38abdcb-982c-449f-af7c-dc264552fed9 False on purple-vds3 >2012-08-05 13:14:03,409 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-68) Initializing Host: purple-vds3 >2012-08-05 13:14:03,933 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Received message: <BSTRAP component='INSTALLER' status='OK' message='Test platform succeeded'/> ><BSTRAP component='INSTALLER LIB' status='OK' message='deployUtil.py download succeeded'/> ><BSTRAP component='INSTALLER' status='OK' message='vds_bootstrap.py download succeeded'/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:14:17,006 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Received message: <BSTRAP component='RHN_REGISTRATION' status='OK' message='Host properly registered with RHN/Satellite.'/> ><BSTRAP component='VDSM_MAJOR_VER' status='OK' message='Available VDSM matches requirements'/> ><BSTRAP component='VT_SVM' status='OK' processor='Intel' message='Server supports virtualization'/> ><BSTRAP component='OS' status='OK' type='RHEL6' message='Supported platform version'/> ><BSTRAP component='KERNEL' status='OK' version='274' message='Supported kernel version: 274'/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:14:18,288 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Received message: <BSTRAP component='REQ PACKAGES' status='OK' result='SDL.x86_64' message='SDL-1.2.14-3.el6.x86_64 '/> ><BSTRAP component='REQ PACKAGES' status='OK' result='bridge-utils.x86_64' message='bridge-utils-1.2-9.el6.x86_64 '/> ><BSTRAP component='REQ PACKAGES' status='OK' result='mesa-libGLU.x86_64' message='mesa-libGLU-7.11-5.el6.x86_64 '/> ><BSTRAP component='REQ PACKAGES' status='OK' result='openssl.x86_64' message='openssl-1.0.0-20.el6_2.4.x86_64 '/> ><BSTRAP component='REQ PACKAGES' status='OK' result='m2crypto.x86_64' message='m2crypto-0.20.2-9.el6.x86_64 '/> ><BSTRAP component='REQ PACKAGES' status='OK' result='rsync.x86_64' message='rsync-3.0.6-9.el6.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='WARN' result='qemu-kvm' message='package qemu-kvm is not installed '/> ><BSTRAP component='VDS PACKAGES' status='WARN' result='qemu-kvm-tools' message='package qemu-kvm-tools is not installed '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='vdsm' message='vdsm-4.9.6-24.0.el6_3.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='vdsm-cli' message='vdsm-cli-4.9.6-24.0.el6_3.noarch '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='libjpeg' message='libjpeg-6b-46.el6.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='spice-server' message='spice-server-0.10.1-10.el6.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='pixman' message='pixman-0.18.4-1.el6_0.1.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='seabios' message='seabios-0.6.1.2-19.el6.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='WARN' result='qemu-img' message='package qemu-img is not installed '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='fence-agents' message='fence-agents-3.1.5-17.el6.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='libselinux-python' message='libselinux-python-2.0.94-5.3.el6.x86_64 '/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:14:25,263 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-3) [68539bf8] Installation of purple-vds2. Received message: <BSTRAP component='RHN_REGISTRATION' status='OK' message='Host properly registered with RHN/Satellite.'/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:14:41,630 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Received message: <BSTRAP component='VDS PACKAGES' status='OK' result='vdsm' message='vdsm-4.9.6-24.0.el6_3.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='vdsm-cli' message='vdsm-cli-4.9.6-24.0.el6_3.noarch '/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:14:42,672 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Received message: <BSTRAP component='VDS PACKAGES' status='OK' result='libjpeg' message='libjpeg-6b-46.el6.x86_64 '/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:14:43,706 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Received message: <BSTRAP component='VDS PACKAGES' status='OK' result='spice-server' message='spice-server-0.10.1-10.el6.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='pixman' message='pixman-0.18.4-1.el6_0.1.x86_64 '/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:14:44,760 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Received message: <BSTRAP component='VDS PACKAGES' status='OK' result='seabios' message='seabios-0.6.1.2-19.el6.x86_64 '/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:14:45,781 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Received message: <BSTRAP component='VDS PACKAGES' status='OK' result='fence-agents' message='fence-agents-3.1.5-17.el6.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='libselinux-python' message='libselinux-python-2.0.94-5.3.el6.x86_64 '/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:14:46,823 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Received message: <BSTRAP component='VDS PACKAGES' status='OK' result='qemu-img' message='package qemu-img is not installed '/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:14:47,846 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Received message: <BSTRAP component='VDS PACKAGES' status='OK' result='qemu-kvm-tools' message='package qemu-kvm-tools is not installed '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='qemu-kvm' message='package qemu-kvm is not installed '/> ><BSTRAP component='CreateConf' status='OK' message='Basic configuration found, skipping this step'/> ><BSTRAP component='CheckLocalHostname' status='OK' message='Local hostname is correct.'/> ><BSTRAP component='SetNetworking' status='OK' message='Bridge management already exists. Skipping bridge creation.'/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:14:48,948 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Received message: <BSTRAP component='SetSSHAccess' status='OK' message='SUCCESS'/> ><BSTRAP component='Firewall' status='OK' message='overridden firewall successfully'/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:14:50,127 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Received message: <BSTRAP component='SET_SYSTEM_TIME' status='OK' message='setSystemTime ended successfully'/> ><BSTRAP component='VerifyServices' status='OK' message='Needed services set'/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:14:55,296 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-3) [68539bf8] Installation of purple-vds2. Received message: <BSTRAP component='VDSM_MAJOR_VER' status='OK' message='Available VDSM matches requirements'/> ><BSTRAP component='VT_SVM' status='OK' processor='Intel' message='Server supports virtualization'/> ><BSTRAP component='OS' status='OK' type='RHEL6' message='Supported platform version'/> ><BSTRAP component='KERNEL' status='OK' version='270' message='Supported kernel version: 270'/> ><BSTRAP component='REQ PACKAGES' status='OK' result='SDL.x86_64' message='SDL-1.2.14-3.el6.x86_64 '/> ><BSTRAP component='REQ PACKAGES' status='OK' result='bridge-utils.x86_64' message='bridge-utils-1.2-9.el6.x86_64 '/> ><BSTRAP component='REQ PACKAGES' status='OK' result='mesa-libGLU.x86_64' message='mesa-libGLU-7.11-4.el6.x86_64 '/> ><BSTRAP component='REQ PACKAGES' status='OK' result='openssl.x86_64' message='openssl-1.0.0-20.el6_2.4.x86_64 '/> ><BSTRAP component='REQ PACKAGES' status='OK' result='m2crypto.x86_64' message='m2crypto-0.20.2-9.el6.x86_64 '/> ><BSTRAP component='REQ PACKAGES' status='OK' result='rsync.x86_64' message='rsync-3.0.6-9.el6.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='WARN' result='qemu-kvm' message='package qemu-kvm is not installed '/> ><BSTRAP component='VDS PACKAGES' status='WARN' result='qemu-kvm-tools' message='package qemu-kvm-tools is not installed '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='vdsm' message='vdsm-4.9.6-24.0.el6_3.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='vdsm-cli' message='vdsm-cli-4.9.6-24.0.el6_3.noarch '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='libjpeg' message='libjpeg-6b-46.el6.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='spice-server' message='spice-server-0.10.1-10.el6.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='pixman' message='pixman-0.18.4-1.el6_0.1.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='seabios' message='seabios-0.6.1.2-19.el6.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='WARN' result='qemu-img' message='package qemu-img is not installed '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='fence-agents' message='fence-agents-3.1.5-17.el6.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='libselinux-python' message='libselinux-python-2.0.94-5.3.el6.x86_64 '/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Checking autorecoverable hosts >2012-08-05 13:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Autorecovering 0 hosts >2012-08-05 13:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Checking autorecoverable hosts done >2012-08-05 13:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Checking autorecoverable storage domains >2012-08-05 13:15:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Autorecovering 0 storage domains >2012-08-05 13:15:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Checking autorecoverable storage domains done >2012-08-05 13:15:04,171 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Received message: <BSTRAP component='Encryption setup' status='OK' message='Ended successfully'/> ><BSTRAP component='RHEV_INSTALL' status='OK'/> >. Stage completed. (Stage: Running first installation script on Host) >2012-08-05 13:15:04,424 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-4) RunSSHCommand returns true >2012-08-05 13:15:04,425 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] RunScript ended:true >2012-08-05 13:15:04,425 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Executing installation stage. (Stage: Downloading certificate request from Host) >2012-08-05 13:15:04,426 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-4) Downloading file /tmp/cert_b38abdcb-982c-449f-af7c-dc264552fed9.req from purple-vds3 to /etc/pki/ovirt-engine/requests/cert_b38abdcb-982c-449f-af7c-dc264552fed9.req >2012-08-05 13:15:04,816 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. successfully done sftp operation ( Stage: Downloading certificate request from Host) >2012-08-05 13:15:04,817 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-4) return true >2012-08-05 13:15:04,817 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] DownloadCertificateRequest ended:true >2012-08-05 13:15:04,818 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Executing installation stage. (Stage: Sign certificate request and generate certificate) >2012-08-05 13:15:05,835 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] SignCertificateRequest ended:true >2012-08-05 13:15:05,836 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Executing installation stage. (Stage: Upload signed sertificate to Host) >2012-08-05 13:15:05,837 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-4) Uploading file /etc/pki/ovirt-engine/certs/purple-vds3cert.pem to /tmp/cert_b38abdcb-982c-449f-af7c-dc264552fed9.pem on purple-vds3 >2012-08-05 13:15:05,838 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-4) Uploading file /etc/pki/ovirt-engine/certs/purple-vds3cert.pem to /tmp/cert_b38abdcb-982c-449f-af7c-dc264552fed9.pem on purple-vds3 >2012-08-05 13:15:06,077 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. successfully done sftp operation ( Stage: Upload signed sertificate to Host) >2012-08-05 13:15:06,077 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-4) return true >2012-08-05 13:15:06,078 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] UploadSignedCertificate ended:true >2012-08-05 13:15:06,078 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Executing installation stage. (Stage: Upload Cerficate Autority to Host) >2012-08-05 13:15:06,079 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-4) Uploading file /etc/pki/ovirt-engine/ca.pem to /tmp/CA_b38abdcb-982c-449f-af7c-dc264552fed9.pem on purple-vds3 >2012-08-05 13:15:06,079 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-4) Uploading file /etc/pki/ovirt-engine/ca.pem to /tmp/CA_b38abdcb-982c-449f-af7c-dc264552fed9.pem on purple-vds3 >2012-08-05 13:15:06,283 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. successfully done sftp operation ( Stage: Upload Cerficate Autority to Host) >2012-08-05 13:15:06,283 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-4) return true >2012-08-05 13:15:06,284 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Executing installation stage. (Stage: Running second installation script on Host) >2012-08-05 13:15:06,285 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Sending SSH Command chmod +x /tmp/vds_installer_b38abdcb-982c-449f-af7c-dc264552fed9.py; /tmp/vds_installer_b38abdcb-982c-449f-af7c-dc264552fed9.py -c 'ssl=true;management_port=54321' -O 'qa.lab.tlv.redhat.com' -t 2012-08-05T10:14:01 -f /tmp/firewall.conf.b38abdcb-982c-449f-af7c-dc264552fed9 -p 80 -b http://leonid-rhevm31.qa.lab.tlv.redhat.com:80/Components/vds/ http://leonid-rhevm31.qa.lab.tlv.redhat.com:80/Components/vds/ purple-vds3 b38abdcb-982c-449f-af7c-dc264552fed9 True. (Stage: Running second installation script on Host) >2012-08-05 13:15:06,287 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-4) Invoking chmod +x /tmp/vds_installer_b38abdcb-982c-449f-af7c-dc264552fed9.py; /tmp/vds_installer_b38abdcb-982c-449f-af7c-dc264552fed9.py -c 'ssl=true;management_port=54321' -O 'qa.lab.tlv.redhat.com' -t 2012-08-05T10:14:01 -f /tmp/firewall.conf.b38abdcb-982c-449f-af7c-dc264552fed9 -p 80 -b http://leonid-rhevm31.qa.lab.tlv.redhat.com:80/Components/vds/ http://leonid-rhevm31.qa.lab.tlv.redhat.com:80/Components/vds/ purple-vds3 b38abdcb-982c-449f-af7c-dc264552fed9 True on purple-vds3 >2012-08-05 13:15:07,291 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Received message: <BSTRAP component='INSTALLER' status='OK' message='Test platform succeeded'/> ><BSTRAP component='INSTALLER LIB' status='OK' message='Install library already exists'/> ><BSTRAP component='INSTALLER' status='OK' message='vds_bootstrap_complete.py download succeeded'/> >. FYI. (Stage: Running second installation script on Host) >2012-08-05 13:15:46,806 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] Installation of purple-vds3. Received message: <BSTRAP component='instCert' status='OK'/> ><BSTRAP component='CoreDump' status='OK'/> ><BSTRAP component='cleanAll' status='OK'/> ><BSTRAP component='VDS Configuration' status='OK'/> ><BSTRAP component='RHEV_INSTALL' status='OK'/> ><BSTRAP component='Reboot' status='OK' message='Rebooting machine' /> >. Stage completed. (Stage: Running second installation script on Host) >2012-08-05 13:15:47,104 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-4) RunSSHCommand returns true >2012-08-05 13:15:47,104 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-4) [59e8140] FinishCommand ended:true >2012-08-05 13:15:47,106 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-3-thread-4) [59e8140] After Installation pool-3-thread-4 >2012-08-05 13:15:47,109 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-4) [59e8140] START, SetVdsStatusVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, status=Reboot, nonOperationalReason=NONE), log id: 14d3638 >2012-08-05 13:15:47,184 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-4) [59e8140] FINISH, SetVdsStatusVDSCommand, log id: 14d3638 >2012-08-05 13:15:47,190 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-3-thread-5) [59e8140] Waiting 300 seconds, for server to finish reboot process. >2012-08-05 13:16:30,166 ERROR [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-3) [68539bf8] Installation of purple-vds2. Received message: <BSTRAP component='VDS PACKAGES' status='FAIL' result='vdsm' message='Loaded plugins: auto-update-debuginfo http://yum.qa.lab.tlv.redhat.com/repodata/repomd.xml: [Errno 12] Timeout on http://yum.qa.lab.tlv.redhat.com/repodata/repomd.xml: (28, ~connect() timed out!~) Trying other mirror. Error: Cannot retrieve repository metadata (repomd.xml) for repository: qa. Please verify its path and try again '/> ><BSTRAP component='RHEV_INSTALL' status='FAIL'/> >. Error occured. (Stage: Running first installation script on Host) >2012-08-05 13:16:30,214 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-3) RunSSHCommand returns true >2012-08-05 13:16:30,214 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-3) [68539bf8] RunScript ended:true >2012-08-05 13:16:30,215 ERROR [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-3) [68539bf8] Installation of purple-vds2. Operation failure. (Stage: Running first installation script on Host) >2012-08-05 13:16:30,216 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-3-thread-3) [68539bf8] After Installation pool-3-thread-3 >2012-08-05 13:16:30,219 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-3) [68539bf8] START, SetVdsStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, status=InstallFailed, nonOperationalReason=NONE), log id: 12430b33 >2012-08-05 13:16:30,283 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-3) [68539bf8] FINISH, SetVdsStatusVDSCommand, log id: 12430b33 >2012-08-05 13:19:20,191 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-1) Adding new value to configuration cache. >2012-08-05 13:19:20,194 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-1) Didnt find the value of DBI18NPrefix in DB for version general - using default: >2012-08-05 13:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable hosts >2012-08-05 13:20:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Autorecovering 0 hosts >2012-08-05 13:20:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable hosts done >2012-08-05 13:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable storage domains >2012-08-05 13:20:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Autorecovering 0 storage domains >2012-08-05 13:20:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable storage domains done >2012-08-05 13:20:27,224 INFO [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp--127.0.0.1-8009-1) [17b555f1] Running command: UpdateVdsCommand internal: false. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-05 13:20:27,332 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (ajp--127.0.0.1-8009-1) [17b555f1] START, SetVdsStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, status=Installing, nonOperationalReason=NONE), log id: 75fc5511 >2012-08-05 13:20:27,342 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (ajp--127.0.0.1-8009-1) [17b555f1] FINISH, SetVdsStatusVDSCommand, log id: 75fc5511 >2012-08-05 13:20:27,364 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-3-thread-6) [67a68649] Running command: InstallVdsCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-05 13:20:27,376 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-3-thread-6) [67a68649] Before Installation pool-3-thread-6 >2012-08-05 13:20:27,377 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Executing installation stage. (Stage: Starting Host installation) >2012-08-05 13:20:27,377 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Executing installation stage. (Stage: Connecting to Host) >2012-08-05 13:20:27,423 INFO [org.ovirt.engine.core.utils.hostinstall.HostKeyVerifier] (NioProcessor-10) SSH key fingerprint 9f:73:26:bd:57:9c:94:3a:f7:29:20:49:2c:43:da:b3 for host purple-vds2 (10.35.102.54) has been successfully verified. >2012-08-05 13:20:27,520 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Received message: <BSTRAP component='RHEV_INSTALL' status='OK' message='Connected to Host purple-vds2 with SSH key fingerprint: 9f:73:26:bd:57:9c:94:3a:f7:29:20:49:2c:43:da:b3'/>. FYI. (Stage: Connecting to Host) >2012-08-05 13:20:27,549 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Successfully connected to server ssh. (Stage: Connecting to Host) >2012-08-05 13:20:27,550 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Executing installation stage. (Stage: Get the unique vds id) >2012-08-05 13:20:27,551 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-6) Invoking /bin/echo -e `/bin/bash -c /usr/sbin/dmidecode|/bin/awk ' /UUID/{ print $2; } ' | /usr/bin/tr ' >' '_' && /bin/cat /sys/class/net/*/address | /bin/sed -e '/00:00:00:00/d' -e '/^$/d' | /bin/sort -u | /usr/bin/head --lines=1` on purple-vds2 >2012-08-05 13:20:27,601 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Received message: CDE7DFEC-B187-11DE-B8CD-00215EC803C0_00:21:5e:c8:03:c0 >. FYI. (Stage: Get the unique vds id) >2012-08-05 13:20:27,605 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Assigning unique id CDE7DFEC-B187-11DE-B8CD-00215EC803C0_00:21:5e:c8:03:c0 to Host. (Stage: Get the unique vds id) >2012-08-05 13:20:27,618 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-6) RunSSHCommand returns true >2012-08-05 13:20:27,618 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Executing installation stage. (Stage: Upload Installation script to Host) >2012-08-05 13:20:27,619 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-6) Uploading file /usr/share/ovirt-engine/scripts/vds_installer.py to /tmp/vds_installer_53a1620a-0bf1-492e-8205-625eb52f3c47.py on purple-vds2 >2012-08-05 13:20:27,620 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-6) Uploading file /usr/share/ovirt-engine/scripts/vds_installer.py to /tmp/vds_installer_53a1620a-0bf1-492e-8205-625eb52f3c47.py on purple-vds2 >2012-08-05 13:20:27,867 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. successfully done sftp operation ( Stage: Upload Installation script to Host) >2012-08-05 13:20:27,868 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-6) return true >2012-08-05 13:20:27,869 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-6) Uploading file /tmp/firewall.conf8056574335211743025.tmp to /tmp/firewall.conf.53a1620a-0bf1-492e-8205-625eb52f3c47 on purple-vds2 >2012-08-05 13:20:27,870 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-6) Uploading file /tmp/firewall.conf8056574335211743025.tmp to /tmp/firewall.conf.53a1620a-0bf1-492e-8205-625eb52f3c47 on purple-vds2 >2012-08-05 13:20:28,111 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. successfully done sftp operation ( Stage: Upload Installation script to Host) >2012-08-05 13:20:28,112 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-6) return true >2012-08-05 13:20:28,112 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Executing installation stage. (Stage: Running first installation script on Host) >2012-08-05 13:20:28,117 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Sending SSH Command chmod +x /tmp/vds_installer_53a1620a-0bf1-492e-8205-625eb52f3c47.py; /tmp/vds_installer_53a1620a-0bf1-492e-8205-625eb52f3c47.py -c 'ssl=true;management_port=54321' -O 'qa.lab.tlv.redhat.com' -t 2012-08-05T10:20:27 -f /tmp/firewall.conf.53a1620a-0bf1-492e-8205-625eb52f3c47 -p 80 -b http://leonid-rhevm31.qa.lab.tlv.redhat.com:80/Components/vds/ http://leonid-rhevm31.qa.lab.tlv.redhat.com:80/Components/vds/ purple-vds2 53a1620a-0bf1-492e-8205-625eb52f3c47 False. (Stage: Running first installation script on Host) >2012-08-05 13:20:28,120 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-6) Invoking chmod +x /tmp/vds_installer_53a1620a-0bf1-492e-8205-625eb52f3c47.py; /tmp/vds_installer_53a1620a-0bf1-492e-8205-625eb52f3c47.py -c 'ssl=true;management_port=54321' -O 'qa.lab.tlv.redhat.com' -t 2012-08-05T10:20:27 -f /tmp/firewall.conf.53a1620a-0bf1-492e-8205-625eb52f3c47 -p 80 -b http://leonid-rhevm31.qa.lab.tlv.redhat.com:80/Components/vds/ http://leonid-rhevm31.qa.lab.tlv.redhat.com:80/Components/vds/ purple-vds2 53a1620a-0bf1-492e-8205-625eb52f3c47 False on purple-vds2 >2012-08-05 13:20:29,124 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Received message: <BSTRAP component='INSTALLER' status='OK' message='Test platform succeeded'/> ><BSTRAP component='INSTALLER LIB' status='OK' message='deployUtil.py download succeeded'/> ><BSTRAP component='INSTALLER' status='OK' message='vds_bootstrap.py download succeeded'/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:20:30,488 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Received message: <BSTRAP component='RHN_REGISTRATION' status='OK' message='Host properly registered with RHN/Satellite.'/> ><BSTRAP component='VDSM_MAJOR_VER' status='OK' message='Available VDSM matches requirements'/> ><BSTRAP component='VT_SVM' status='OK' processor='Intel' message='Server supports virtualization'/> ><BSTRAP component='OS' status='OK' type='RHEL6' message='Supported platform version'/> ><BSTRAP component='KERNEL' status='OK' version='270' message='Supported kernel version: 270'/> ><BSTRAP component='REQ PACKAGES' status='OK' result='SDL.x86_64' message='SDL-1.2.14-3.el6.x86_64 '/> ><BSTRAP component='REQ PACKAGES' status='OK' result='bridge-utils.x86_64' message='bridge-utils-1.2-9.el6.x86_64 '/> ><BSTRAP component='REQ PACKAGES' status='OK' result='mesa-libGLU.x86_64' message='mesa-libGLU-7.11-4.el6.x86_64 '/> ><BSTRAP component='REQ PACKAGES' status='OK' result='openssl.x86_64' message='openssl-1.0.0-20.el6_2.4.x86_64 '/> ><BSTRAP component='REQ PACKAGES' status='OK' result='m2crypto.x86_64' message='m2crypto-0.20.2-9.el6.x86_64 '/> ><BSTRAP component='REQ PACKAGES' status='OK' result='rsync.x86_64' message='rsync-3.0.6-9.el6.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='WARN' result='qemu-kvm' message='package qemu-kvm is not installed '/> ><BSTRAP component='VDS PACKAGES' status='WARN' result='qemu-kvm-tools' message='package qemu-kvm-tools is not installed '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='vdsm' message='vdsm-4.9.6-24.0.el6_3.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='vdsm-cli' message='vdsm-cli-4.9.6-24.0.el6_3.noarch '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='libjpeg' message='libjpeg-6b-46.el6.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='spice-server' message='spice-server-0.10.1-10.el6.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='pixman' message='pixman-0.18.4-1.el6_0.1.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='seabios' message='seabios-0.6.1.2-19.el6.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='WARN' result='qemu-img' message='package qemu-img is not installed '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='fence-agents' message='fence-agents-3.1.5-17.el6.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='libselinux-python' message='libselinux-python-2.0.94-5.3.el6.x86_64 '/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:20:47,193 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-5) [59e8140] START, SetVdsStatusVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, status=NonResponsive, nonOperationalReason=NONE), log id: 158b4c86 >2012-08-05 13:20:47,229 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-5) [59e8140] FINISH, SetVdsStatusVDSCommand, log id: 158b4c86 >2012-08-05 13:20:53,036 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Received message: <BSTRAP component='VDS PACKAGES' status='OK' result='vdsm' message='vdsm-4.9.6-24.0.el6_3.x86_64 '/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:20:54,059 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Received message: <BSTRAP component='VDS PACKAGES' status='OK' result='vdsm-cli' message='vdsm-cli-4.9.6-24.0.el6_3.noarch '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='libjpeg' message='libjpeg-6b-46.el6.x86_64 '/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:20:55,241 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Received message: <BSTRAP component='VDS PACKAGES' status='OK' result='spice-server' message='spice-server-0.10.1-10.el6.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='pixman' message='pixman-0.18.4-1.el6_0.1.x86_64 '/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:20:56,321 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Received message: <BSTRAP component='VDS PACKAGES' status='OK' result='seabios' message='seabios-0.6.1.2-19.el6.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='fence-agents' message='fence-agents-3.1.5-17.el6.x86_64 '/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:20:57,377 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Received message: <BSTRAP component='VDS PACKAGES' status='OK' result='libselinux-python' message='libselinux-python-2.0.94-5.3.el6.x86_64 '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='qemu-img' message='package qemu-img is not installed '/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:20:58,433 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Received message: <BSTRAP component='VDS PACKAGES' status='OK' result='qemu-kvm-tools' message='package qemu-kvm-tools is not installed '/> ><BSTRAP component='VDS PACKAGES' status='OK' result='qemu-kvm' message='package qemu-kvm is not installed '/> ><BSTRAP component='CreateConf' status='OK' message='Basic configuration found, skipping this step'/> ><BSTRAP component='CheckLocalHostname' status='OK' message='Local hostname is correct.'/> ><BSTRAP component='SetNetworking' status='OK' message='Bridge management already exists. Skipping bridge creation.'/> ><BSTRAP component='SetSSHAccess' status='OK' message='SUCCESS'/> ><BSTRAP component='Firewall' status='OK' message='overridden firewall successfully'/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:21:00,620 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Received message: <BSTRAP component='SET_SYSTEM_TIME' status='OK' message='setSystemTime ended successfully'/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:21:01,647 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Received message: <BSTRAP component='VerifyServices' status='OK' message='Needed services set'/> >. FYI. (Stage: Running first installation script on Host) >2012-08-05 13:21:10,839 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Received message: <BSTRAP component='Encryption setup' status='OK' message='Ended successfully'/> ><BSTRAP component='RHEV_INSTALL' status='OK'/> >. Stage completed. (Stage: Running first installation script on Host) >2012-08-05 13:21:10,878 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-6) RunSSHCommand returns true >2012-08-05 13:21:10,878 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] RunScript ended:true >2012-08-05 13:21:10,879 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Executing installation stage. (Stage: Downloading certificate request from Host) >2012-08-05 13:21:10,880 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-6) Downloading file /tmp/cert_53a1620a-0bf1-492e-8205-625eb52f3c47.req from purple-vds2 to /etc/pki/ovirt-engine/requests/cert_53a1620a-0bf1-492e-8205-625eb52f3c47.req >2012-08-05 13:21:11,079 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. successfully done sftp operation ( Stage: Downloading certificate request from Host) >2012-08-05 13:21:11,080 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-6) return true >2012-08-05 13:21:11,081 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] DownloadCertificateRequest ended:true >2012-08-05 13:21:11,081 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Executing installation stage. (Stage: Sign certificate request and generate certificate) >2012-08-05 13:21:12,087 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] SignCertificateRequest ended:true >2012-08-05 13:21:12,087 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Executing installation stage. (Stage: Upload signed sertificate to Host) >2012-08-05 13:21:12,088 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-6) Uploading file /etc/pki/ovirt-engine/certs/purple-vds2cert.pem to /tmp/cert_53a1620a-0bf1-492e-8205-625eb52f3c47.pem on purple-vds2 >2012-08-05 13:21:12,089 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-6) Uploading file /etc/pki/ovirt-engine/certs/purple-vds2cert.pem to /tmp/cert_53a1620a-0bf1-492e-8205-625eb52f3c47.pem on purple-vds2 >2012-08-05 13:21:12,292 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. successfully done sftp operation ( Stage: Upload signed sertificate to Host) >2012-08-05 13:21:12,293 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-6) return true >2012-08-05 13:21:12,293 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] UploadSignedCertificate ended:true >2012-08-05 13:21:12,293 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Executing installation stage. (Stage: Upload Cerficate Autority to Host) >2012-08-05 13:21:12,294 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-6) Uploading file /etc/pki/ovirt-engine/ca.pem to /tmp/CA_53a1620a-0bf1-492e-8205-625eb52f3c47.pem on purple-vds2 >2012-08-05 13:21:12,295 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-6) Uploading file /etc/pki/ovirt-engine/ca.pem to /tmp/CA_53a1620a-0bf1-492e-8205-625eb52f3c47.pem on purple-vds2 >2012-08-05 13:21:12,504 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. successfully done sftp operation ( Stage: Upload Cerficate Autority to Host) >2012-08-05 13:21:12,504 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-6) return true >2012-08-05 13:21:12,505 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Executing installation stage. (Stage: Running second installation script on Host) >2012-08-05 13:21:12,506 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Sending SSH Command chmod +x /tmp/vds_installer_53a1620a-0bf1-492e-8205-625eb52f3c47.py; /tmp/vds_installer_53a1620a-0bf1-492e-8205-625eb52f3c47.py -c 'ssl=true;management_port=54321' -O 'qa.lab.tlv.redhat.com' -t 2012-08-05T10:20:27 -f /tmp/firewall.conf.53a1620a-0bf1-492e-8205-625eb52f3c47 -p 80 -b http://leonid-rhevm31.qa.lab.tlv.redhat.com:80/Components/vds/ http://leonid-rhevm31.qa.lab.tlv.redhat.com:80/Components/vds/ purple-vds2 53a1620a-0bf1-492e-8205-625eb52f3c47 True. (Stage: Running second installation script on Host) >2012-08-05 13:21:12,512 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-6) Invoking chmod +x /tmp/vds_installer_53a1620a-0bf1-492e-8205-625eb52f3c47.py; /tmp/vds_installer_53a1620a-0bf1-492e-8205-625eb52f3c47.py -c 'ssl=true;management_port=54321' -O 'qa.lab.tlv.redhat.com' -t 2012-08-05T10:20:27 -f /tmp/firewall.conf.53a1620a-0bf1-492e-8205-625eb52f3c47 -p 80 -b http://leonid-rhevm31.qa.lab.tlv.redhat.com:80/Components/vds/ http://leonid-rhevm31.qa.lab.tlv.redhat.com:80/Components/vds/ purple-vds2 53a1620a-0bf1-492e-8205-625eb52f3c47 True on purple-vds2 >2012-08-05 13:21:13,523 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Received message: <BSTRAP component='INSTALLER' status='OK' message='Test platform succeeded'/> ><BSTRAP component='INSTALLER LIB' status='OK' message='Install library already exists'/> ><BSTRAP component='INSTALLER' status='OK' message='vds_bootstrap_complete.py download succeeded'/> >. FYI. (Stage: Running second installation script on Host) >2012-08-05 13:21:42,567 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] Installation of purple-vds2. Received message: <BSTRAP component='instCert' status='OK'/> ><BSTRAP component='CoreDump' status='OK'/> ><BSTRAP component='cleanAll' status='OK'/> ><BSTRAP component='VDS Configuration' status='OK'/> ><BSTRAP component='RHEV_INSTALL' status='OK'/> ><BSTRAP component='Reboot' status='OK' message='Rebooting machine' /> >. Stage completed. (Stage: Running second installation script on Host) >2012-08-05 13:21:42,796 INFO [org.ovirt.engine.core.utils.hostinstall.MinaInstallWrapper] (pool-3-thread-6) RunSSHCommand returns true >2012-08-05 13:21:42,796 INFO [org.ovirt.engine.core.bll.VdsInstaller] (pool-3-thread-6) [67a68649] FinishCommand ended:true >2012-08-05 13:21:42,798 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-3-thread-6) [67a68649] After Installation pool-3-thread-6 >2012-08-05 13:21:42,799 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-6) [67a68649] START, SetVdsStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, status=Reboot, nonOperationalReason=NONE), log id: 6822f888 >2012-08-05 13:21:42,855 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-6) [67a68649] FINISH, SetVdsStatusVDSCommand, log id: 6822f888 >2012-08-05 13:21:42,863 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-3-thread-34) [67a68649] Waiting 300 seconds, for server to finish reboot process. >2012-08-05 13:22:15,531 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-84) [4f67c3aa] Running command: InitVdsOnUpCommand internal: true. >2012-08-05 13:22:15,561 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-84) [4f67c3aa] No string for UNASSIGNED type. Use default Log >2012-08-05 13:22:15,580 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) [4f67c3aa] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-08-05 13:22:15,603 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-84) [7bd88f5c] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-05 13:22:15,827 INFO [org.ovirt.engine.core.bll.UpdateVdsGroupCommand] (QuartzScheduler_Worker-84) [13981beb] Running command: UpdateVdsGroupCommand internal: true. Entities affected : ID: 99408929-82cf-4dc7-a532-9d998063fa95 Type: VdsGroups >2012-08-05 13:22:15,923 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-84) [133550ed] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-05 13:24:29,771 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-52) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:24:31,790 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-55) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:24:33,806 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-56) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:24:35,821 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-58) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:24:37,837 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-62) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:24:39,870 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-64) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:24:41,898 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-66) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:24:43,916 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-68) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:24:45,927 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-70) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:24:47,947 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-74) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:24:49,960 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-76) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:24:51,977 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-77) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:24:53,991 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-80) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:24:56,071 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-85) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:24:58,112 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-89) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Checking autorecoverable hosts >2012-08-05 13:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Autorecovering 0 hosts >2012-08-05 13:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Checking autorecoverable hosts done >2012-08-05 13:25:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Checking autorecoverable storage domains >2012-08-05 13:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Autorecovering 0 storage domains >2012-08-05 13:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Checking autorecoverable storage domains done >2012-08-05 13:25:00,127 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-92) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:25:02,146 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-94) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:25:04,174 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-96) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:25:06,195 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-100) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:25:08,208 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-2) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:25:10,225 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-3) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:25:12,241 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-6) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:25:14,264 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-8) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:25:16,278 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-11) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:25:18,295 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-15) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:25:20,312 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-16) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:25:22,339 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-18) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:25:24,360 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-20) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:25:26,389 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-25) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-05 13:25:28,412 ERROR [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-27) VDS::handleNetworkException Server failed to respond, vds_id = 47028088-dee6-11e1-bffa-2f8f15de3134, vds_name = purple-vds3, error = VDSNetworkException: >2012-08-05 13:25:28,435 INFO [org.ovirt.engine.core.bll.VdsEventListener] (pool-3-thread-49) ResourceManager::vdsNotResponding entered for Host 47028088-dee6-11e1-bffa-2f8f15de3134, purple-vds3 >2012-08-05 13:25:28,558 ERROR [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (pool-3-thread-49) [1d2b63aa] Failed to run Fence script on vds:purple-vds3, VMs moved to UnKnown instead. >2012-08-05 13:26:42,864 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-34) [67a68649] START, SetVdsStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, status=NonResponsive, nonOperationalReason=NONE), log id: 79db7ebb >2012-08-05 13:26:42,915 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-34) [67a68649] FINISH, SetVdsStatusVDSCommand, log id: 79db7ebb >2012-08-05 13:29:43,905 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-18) XML RPC error in command GetCapabilitiesVDS ( Vds: purple-vds2 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-05 13:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable hosts >2012-08-05 13:30:00,042 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Autorecovering 0 hosts >2012-08-05 13:30:00,042 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable hosts done >2012-08-05 13:30:00,043 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable storage domains >2012-08-05 13:30:00,048 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Autorecovering 0 storage domains >2012-08-05 13:30:00,048 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable storage domains done >2012-08-05 13:30:17,318 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-81) [3b025439] Running command: InitVdsOnUpCommand internal: true. >2012-08-05 13:30:17,332 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-81) [3b025439] No string for UNASSIGNED type. Use default Log >2012-08-05 13:30:17,337 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) [3b025439] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-08-05 13:30:17,373 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-81) [fe9c93a] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-05 13:30:17,382 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-81) [5253de14] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-05 13:32:45,987 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-53) XML RPC error in command GetCapabilitiesVDS ( Vds: purple-vds2 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-05 13:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Checking autorecoverable hosts >2012-08-05 13:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Autorecovering 0 hosts >2012-08-05 13:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Checking autorecoverable hosts done >2012-08-05 13:35:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Checking autorecoverable storage domains >2012-08-05 13:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Autorecovering 0 storage domains >2012-08-05 13:35:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Checking autorecoverable storage domains done >2012-08-05 13:35:47,993 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-92) XML RPC error in command GetCapabilitiesVDS ( Vds: purple-vds2 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-05 13:38:50,024 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) XML RPC error in command GetCapabilitiesVDS ( Vds: purple-vds2 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-05 13:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Checking autorecoverable hosts >2012-08-05 13:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Autorecovering 0 hosts >2012-08-05 13:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Checking autorecoverable hosts done >2012-08-05 13:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Checking autorecoverable storage domains >2012-08-05 13:40:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Autorecovering 0 storage domains >2012-08-05 13:40:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Checking autorecoverable storage domains done >2012-08-05 13:41:33,275 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-66) [544aaa98] Running command: InitVdsOnUpCommand internal: true. >2012-08-05 13:41:33,288 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-66) [544aaa98] No string for UNASSIGNED type. Use default Log >2012-08-05 13:41:33,295 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-34) [544aaa98] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-08-05 13:41:33,346 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-66) [7c7bc0ca] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-05 13:41:33,367 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-66) [327cc900] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-05 13:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable hosts >2012-08-05 13:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Autorecovering 0 hosts >2012-08-05 13:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable hosts done >2012-08-05 13:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable storage domains >2012-08-05 13:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Autorecovering 0 storage domains >2012-08-05 13:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable storage domains done >2012-08-05 13:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) Checking autorecoverable hosts >2012-08-05 13:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) Autorecovering 0 hosts >2012-08-05 13:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) Checking autorecoverable hosts done >2012-08-05 13:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) Checking autorecoverable storage domains >2012-08-05 13:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) Autorecovering 0 storage domains >2012-08-05 13:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) Checking autorecoverable storage domains done >2012-08-05 13:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable hosts >2012-08-05 13:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Autorecovering 0 hosts >2012-08-05 13:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable hosts done >2012-08-05 13:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable storage domains >2012-08-05 13:55:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Autorecovering 0 storage domains >2012-08-05 13:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable storage domains done >2012-08-05 14:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable hosts >2012-08-05 14:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Autorecovering 0 hosts >2012-08-05 14:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable hosts done >2012-08-05 14:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable storage domains >2012-08-05 14:00:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Autorecovering 0 storage domains >2012-08-05 14:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable storage domains done >2012-08-05 14:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts >2012-08-05 14:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering 0 hosts >2012-08-05 14:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts done >2012-08-05 14:05:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable storage domains >2012-08-05 14:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering 0 storage domains >2012-08-05 14:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable storage domains done >2012-08-05 14:09:55,586 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-71) DbUserCacheManager::refreshAllUserData() - entered >2012-08-05 14:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Checking autorecoverable hosts >2012-08-05 14:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Autorecovering 0 hosts >2012-08-05 14:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Checking autorecoverable hosts done >2012-08-05 14:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Checking autorecoverable storage domains >2012-08-05 14:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Autorecovering 0 storage domains >2012-08-05 14:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Checking autorecoverable storage domains done >2012-08-05 14:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Checking autorecoverable hosts >2012-08-05 14:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Autorecovering 0 hosts >2012-08-05 14:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Checking autorecoverable hosts done >2012-08-05 14:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Checking autorecoverable storage domains >2012-08-05 14:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Autorecovering 0 storage domains >2012-08-05 14:15:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Checking autorecoverable storage domains done >2012-08-05 14:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Checking autorecoverable hosts >2012-08-05 14:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Autorecovering 0 hosts >2012-08-05 14:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Checking autorecoverable hosts done >2012-08-05 14:20:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Checking autorecoverable storage domains >2012-08-05 14:20:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Autorecovering 0 storage domains >2012-08-05 14:20:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Checking autorecoverable storage domains done >2012-08-05 14:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Checking autorecoverable hosts >2012-08-05 14:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Autorecovering 0 hosts >2012-08-05 14:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Checking autorecoverable hosts done >2012-08-05 14:25:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Checking autorecoverable storage domains >2012-08-05 14:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Autorecovering 0 storage domains >2012-08-05 14:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Checking autorecoverable storage domains done >2012-08-05 14:27:36,987 INFO [org.ovirt.engine.core.bll.storage.UpdateStoragePoolCommand] (ajp--127.0.0.1-8009-1) [2c9b9fff] Running command: UpdateStoragePoolCommand internal: false. Entities affected : ID: 66f96b6e-dee5-11e1-a6fd-f39cbdf23023 Type: StoragePool >2012-08-05 14:27:44,441 INFO [org.ovirt.engine.core.bll.UpdateVdsGroupCommand] (ajp--127.0.0.1-8009-10) [3fe03b29] Running command: UpdateVdsGroupCommand internal: false. Entities affected : ID: 99408929-82cf-4dc7-a532-9d998063fa95 Type: VdsGroups >2012-08-05 14:27:48,531 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-3) START, GetDeviceListVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storageType=ISCSI), log id: 22600d6f >2012-08-05 14:28:29,197 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-3) FINISH, GetDeviceListVDSCommand, return: [], log id: 22600d6f >2012-08-05 14:28:44,613 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-10) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 6304664b >2012-08-05 14:28:45,495 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-10) FINISH, GetDeviceListVDSCommand, return: [], log id: 6304664b >2012-08-05 14:28:59,242 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-4) START, DiscoverSendTargetsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, connection=org.ovirt.engine.core.common.businessentities.storage_server_connections@0), log id: c0c7b1b >2012-08-05 14:28:59,505 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--127.0.0.1-8009-4) Command org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand return value > Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.IQNListReturnForXmlRpc >fullTargets false >iqnList >mStatus Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc >mCode 475 >mMessage Failed discovery of iSCSI targets: "portal=IscsiPortal(hostname='10.35.160.8', port=3260), err=(21, [], ['iscsiadm: No portals found'])" > > >2012-08-05 14:28:59,517 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--127.0.0.1-8009-4) Vds: purple-vds3 >2012-08-05 14:28:59,519 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (ajp--127.0.0.1-8009-4) Command DiscoverSendTargetsVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed in vdscommand to DiscoverSendTargetsVDS, error = Failed discovery of iSCSI targets: "portal=IscsiPortal(hostname='10.35.160.8', port=3260), err=(21, [], ['iscsiadm: No portals found'])" >2012-08-05 14:28:59,526 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-4) FINISH, DiscoverSendTargetsVDSCommand, log id: c0c7b1b >2012-08-05 14:28:59,530 ERROR [org.ovirt.engine.core.bll.storage.DiscoverSendTargetsQuery] (ajp--127.0.0.1-8009-4) Query DiscoverSendTargetsQuery failed. Exception message is VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed in vdscommand to DiscoverSendTargetsVDS, error = Failed discovery of iSCSI targets: "portal=IscsiPortal(hostname='10.35.160.8', port=3260), err=(21, [], ['iscsiadm: No portals found'])" >2012-08-05 14:29:03,360 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-1) START, DiscoverSendTargetsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, connection=org.ovirt.engine.core.common.businessentities.storage_server_connections@0), log id: 614d60d >2012-08-05 14:29:03,516 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-1) FINISH, DiscoverSendTargetsVDSCommand, return: [org.ovirt.engine.core.common.businessentities.storage_server_connections@0], log id: 614d60d >2012-08-05 14:29:06,685 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-9) [4a09794e] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.160.9 };]), log id: 6b287823 >2012-08-05 14:29:06,759 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-9) [4a09794e] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 6b287823 >2012-08-05 14:29:06,797 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-9) [4a09794e] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-05 14:29:06,804 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-9) [4a09794e] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.160.9 };]), log id: 75795ff7 >2012-08-05 14:29:07,470 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-9) [4a09794e] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 75795ff7 >2012-08-05 14:29:07,554 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-5) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 551d06b7 >2012-08-05 14:29:08,381 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-5) FINISH, GetDeviceListVDSCommand, return: [], log id: 551d06b7 >2012-08-05 14:29:18,921 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-11) START, DiscoverSendTargetsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, connection=org.ovirt.engine.core.common.businessentities.storage_server_connections@0), log id: 1c4e7c90 >2012-08-05 14:29:19,078 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--127.0.0.1-8009-11) Command org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand return value > Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.IQNListReturnForXmlRpc >fullTargets false >iqnList >mStatus Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc >mCode 475 >mMessage Failed discovery of iSCSI targets: "portal=IscsiPortal(hostname='10.35.160.10', port=3260), err=(21, [], ['iscsiadm: No portals found'])" > > >2012-08-05 14:29:19,083 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--127.0.0.1-8009-11) Vds: purple-vds3 >2012-08-05 14:29:19,085 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (ajp--127.0.0.1-8009-11) Command DiscoverSendTargetsVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed in vdscommand to DiscoverSendTargetsVDS, error = Failed discovery of iSCSI targets: "portal=IscsiPortal(hostname='10.35.160.10', port=3260), err=(21, [], ['iscsiadm: No portals found'])" >2012-08-05 14:29:19,091 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-11) FINISH, DiscoverSendTargetsVDSCommand, log id: 1c4e7c90 >2012-08-05 14:29:19,094 ERROR [org.ovirt.engine.core.bll.storage.DiscoverSendTargetsQuery] (ajp--127.0.0.1-8009-11) Query DiscoverSendTargetsQuery failed. Exception message is VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed in vdscommand to DiscoverSendTargetsVDS, error = Failed discovery of iSCSI targets: "portal=IscsiPortal(hostname='10.35.160.10', port=3260), err=(21, [], ['iscsiadm: No portals found'])" >2012-08-05 14:29:48,283 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-2) START, DiscoverSendTargetsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, connection=org.ovirt.engine.core.common.businessentities.storage_server_connections@0), log id: 7622fd4f >2012-08-05 14:29:48,484 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-2) FINISH, DiscoverSendTargetsVDSCommand, return: [org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0], log id: 7622fd4f >2012-08-05 14:29:53,442 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-8) [7f9be561] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.81 };]), log id: 342a2e89 >2012-08-05 14:29:53,501 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-8) [7f9be561] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 342a2e89 >2012-08-05 14:29:53,536 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-8) [7f9be561] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-05 14:29:53,539 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-8) [7f9be561] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.81 };]), log id: 76d25826 >2012-08-05 14:29:54,353 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-8) [7f9be561] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=476}, log id: 76d25826 >2012-08-05 14:29:54,381 ERROR [org.ovirt.engine.core.bll.storage.ISCSIStorageHelper] (ajp--127.0.0.1-8009-8) [7f9be561] The connection with details 00000000-0000-0000-0000-000000000000 failed because of error code 476 and error message is: failed to login to iscsi node due to authorization failure >2012-08-05 14:29:54,414 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-8) [7f9be561] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2012-08-05 14:29:54,632 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-5) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 7e85aba4 >2012-08-05 14:29:55,434 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-5) FINISH, GetDeviceListVDSCommand, return: [], log id: 7e85aba4 >2012-08-05 14:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable hosts >2012-08-05 14:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Autorecovering 0 hosts >2012-08-05 14:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable hosts done >2012-08-05 14:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable storage domains >2012-08-05 14:30:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Autorecovering 0 storage domains >2012-08-05 14:30:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable storage domains done >2012-08-05 14:30:00,671 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-4) [78a7bbf] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.81 };]), log id: 633b9ae8 >2012-08-05 14:30:00,712 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-4) [78a7bbf] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 633b9ae8 >2012-08-05 14:30:00,757 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-4) [78a7bbf] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-05 14:30:00,764 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-4) [78a7bbf] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.81 };]), log id: 1860c21e >2012-08-05 14:30:01,538 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-4) [78a7bbf] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=476}, log id: 1860c21e >2012-08-05 14:30:01,547 ERROR [org.ovirt.engine.core.bll.storage.ISCSIStorageHelper] (ajp--127.0.0.1-8009-4) [78a7bbf] The connection with details 00000000-0000-0000-0000-000000000000 failed because of error code 476 and error message is: failed to login to iscsi node due to authorization failure >2012-08-05 14:30:01,551 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-4) [78a7bbf] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2012-08-05 14:30:01,728 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-11) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 1285b404 >2012-08-05 14:30:02,535 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-11) FINISH, GetDeviceListVDSCommand, return: [], log id: 1285b404 >2012-08-05 14:30:05,563 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-3) [1d7ed30] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: [lion] };]), log id: 6e511c72 >2012-08-05 14:30:05,594 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-3) [1d7ed30] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 6e511c72 >2012-08-05 14:30:05,635 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-3) [1d7ed30] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-05 14:30:05,642 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-3) [1d7ed30] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: [lion] };]), log id: 32558a5d >2012-08-05 14:31:05,677 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-11) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 2c16d5b8 >2012-08-05 14:32:08,125 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-3) [1d7ed30] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=465}, log id: 32558a5d >2012-08-05 14:32:08,130 ERROR [org.ovirt.engine.core.bll.storage.ISCSIStorageHelper] (ajp--127.0.0.1-8009-3) [1d7ed30] The connection with details 00000000-0000-0000-0000-000000000000 failed because of error code 465 and error message is: failed to setup iscsi subsystem >2012-08-05 14:32:08,144 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-3) [1d7ed30] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2012-08-05 14:32:08,817 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-11) FINISH, GetDeviceListVDSCommand, return: [], log id: 2c16d5b8 >2012-08-05 14:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts >2012-08-05 14:35:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering 0 hosts >2012-08-05 14:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts done >2012-08-05 14:35:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable storage domains >2012-08-05 14:35:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering 0 storage domains >2012-08-05 14:35:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable storage domains done >2012-08-05 14:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable hosts >2012-08-05 14:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Autorecovering 0 hosts >2012-08-05 14:40:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable hosts done >2012-08-05 14:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable storage domains >2012-08-05 14:40:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Autorecovering 0 storage domains >2012-08-05 14:40:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable storage domains done >2012-08-05 14:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Checking autorecoverable hosts >2012-08-05 14:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Autorecovering 0 hosts >2012-08-05 14:45:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Checking autorecoverable hosts done >2012-08-05 14:45:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Checking autorecoverable storage domains >2012-08-05 14:45:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Autorecovering 0 storage domains >2012-08-05 14:45:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Checking autorecoverable storage domains done >2012-08-05 14:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Checking autorecoverable hosts >2012-08-05 14:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Autorecovering 0 hosts >2012-08-05 14:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Checking autorecoverable hosts done >2012-08-05 14:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Checking autorecoverable storage domains >2012-08-05 14:50:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Autorecovering 0 storage domains >2012-08-05 14:50:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Checking autorecoverable storage domains done >2012-08-05 14:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Checking autorecoverable hosts >2012-08-05 14:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Autorecovering 0 hosts >2012-08-05 14:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Checking autorecoverable hosts done >2012-08-05 14:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Checking autorecoverable storage domains >2012-08-05 14:55:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Autorecovering 0 storage domains >2012-08-05 14:55:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Checking autorecoverable storage domains done >2012-08-05 15:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable hosts >2012-08-05 15:00:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Autorecovering 0 hosts >2012-08-05 15:00:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable hosts done >2012-08-05 15:00:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable storage domains >2012-08-05 15:00:00,021 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Autorecovering 0 storage domains >2012-08-05 15:00:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable storage domains done >2012-08-05 15:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable hosts >2012-08-05 15:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Autorecovering 0 hosts >2012-08-05 15:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable hosts done >2012-08-05 15:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable storage domains >2012-08-05 15:05:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Autorecovering 0 storage domains >2012-08-05 15:05:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable storage domains done >2012-08-05 15:09:55,589 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-100) DbUserCacheManager::refreshAllUserData() - entered >2012-08-05 15:09:59,262 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp--127.0.0.1-8009-8) [30b50a82] Running command: LogoutUserCommand internal: false. >2012-08-05 15:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Checking autorecoverable hosts >2012-08-05 15:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Autorecovering 0 hosts >2012-08-05 15:10:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Checking autorecoverable hosts done >2012-08-05 15:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Checking autorecoverable storage domains >2012-08-05 15:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Autorecovering 0 storage domains >2012-08-05 15:10:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Checking autorecoverable storage domains done >2012-08-05 15:11:49,935 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-10) Checking if user admin@internal is an admin, result true >2012-08-05 15:11:49,936 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-10) Running command: LoginAdminUserCommand internal: false. >2012-08-05 15:12:22,425 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-9) Checking if user admin@internal is an admin, result true >2012-08-05 15:12:22,427 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-9) Running command: LoginAdminUserCommand internal: false. >2012-08-05 15:12:30,866 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-5) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 59ab26b1 >2012-08-05 15:12:31,734 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-5) FINISH, GetDeviceListVDSCommand, return: [], log id: 59ab26b1 >2012-08-05 15:12:34,322 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-9) START, GetDeviceListVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storageType=ISCSI), log id: 7971f26 >2012-08-05 15:12:36,496 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-9) FINISH, GetDeviceListVDSCommand, return: [], log id: 7971f26 >2012-08-05 15:12:38,286 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-4) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 47013974 >2012-08-05 15:12:39,060 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-4) FINISH, GetDeviceListVDSCommand, return: [], log id: 47013974 >2012-08-05 15:12:43,767 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-11) START, DiscoverSendTargetsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, connection=org.ovirt.engine.core.common.businessentities.storage_server_connections@0), log id: 61d6f1f9 >2012-08-05 15:12:43,943 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-11) FINISH, DiscoverSendTargetsVDSCommand, return: [org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0], log id: 61d6f1f9 >2012-08-05 15:12:54,859 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-9) [2096286c] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.81 };]), log id: 6ebec845 >2012-08-05 15:12:54,896 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-9) [2096286c] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 6ebec845 >2012-08-05 15:12:54,937 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-9) [2096286c] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-05 15:12:54,943 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-9) [2096286c] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.81 };]), log id: 326f387c >2012-08-05 15:12:55,564 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-9) [2096286c] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 326f387c >2012-08-05 15:12:55,715 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-2) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 60395562 >2012-08-05 15:12:56,512 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-2) FINISH, GetDeviceListVDSCommand, return: [], log id: 60395562 >2012-08-05 15:13:07,154 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-11) [1139d512] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.81 };]), log id: bd4ff86 >2012-08-05 15:13:07,206 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-11) [1139d512] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: bd4ff86 >2012-08-05 15:13:07,239 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-11) [1139d512] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-05 15:13:07,246 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-11) [1139d512] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.81 };]), log id: 66962713 >2012-08-05 15:13:07,859 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-11) [1139d512] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 66962713 >2012-08-05 15:13:08,012 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-6) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 624d6e47 >2012-08-05 15:13:09,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-6) FINISH, GetDeviceListVDSCommand, return: [], log id: 624d6e47 >2012-08-05 15:13:19,054 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-8) [57b310d1] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.81 };]), log id: 3a741c98 >2012-08-05 15:13:19,082 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-8) [57b310d1] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 3a741c98 >2012-08-05 15:13:19,138 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-8) [57b310d1] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-05 15:13:19,146 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-8) [57b310d1] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.81 };]), log id: 6a78f5f5 >2012-08-05 15:13:19,777 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-8) [57b310d1] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 6a78f5f5 >2012-08-05 15:13:19,971 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-9) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 35b20e38 >2012-08-05 15:13:20,792 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-9) FINISH, GetDeviceListVDSCommand, return: [], log id: 35b20e38 >2012-08-05 15:13:34,096 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-4) [2dcedd1a] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: [lion] };]), log id: 11e0921c >2012-08-05 15:13:34,138 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-4) [2dcedd1a] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 11e0921c >2012-08-05 15:13:34,170 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-4) [2dcedd1a] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-05 15:13:34,176 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-4) [2dcedd1a] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: [lion] };]), log id: 5413d5b1 >2012-08-05 15:14:34,221 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-1) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 4c9fa22b >2012-08-05 15:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Checking autorecoverable hosts >2012-08-05 15:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Autorecovering 0 hosts >2012-08-05 15:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Checking autorecoverable hosts done >2012-08-05 15:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Checking autorecoverable storage domains >2012-08-05 15:15:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Autorecovering 0 storage domains >2012-08-05 15:15:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Checking autorecoverable storage domains done >2012-08-05 15:15:01,914 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-9) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 19d353a6 >2012-08-05 15:15:36,080 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-4) [2dcedd1a] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=465}, log id: 5413d5b1 >2012-08-05 15:15:36,099 ERROR [org.ovirt.engine.core.bll.storage.ISCSIStorageHelper] (ajp--127.0.0.1-8009-4) [2dcedd1a] The connection with details 00000000-0000-0000-0000-000000000000 failed because of error code 465 and error message is: failed to setup iscsi subsystem >2012-08-05 15:15:36,121 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-4) [2dcedd1a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2012-08-05 15:15:36,782 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-1) FINISH, GetDeviceListVDSCommand, return: [], log id: 4c9fa22b >2012-08-05 15:15:37,205 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-9) FINISH, GetDeviceListVDSCommand, return: [], log id: 19d353a6 >2012-08-05 15:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Checking autorecoverable hosts >2012-08-05 15:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Autorecovering 0 hosts >2012-08-05 15:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Checking autorecoverable hosts done >2012-08-05 15:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Checking autorecoverable storage domains >2012-08-05 15:20:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Autorecovering 0 storage domains >2012-08-05 15:20:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Checking autorecoverable storage domains done >2012-08-05 15:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Checking autorecoverable hosts >2012-08-05 15:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Autorecovering 0 hosts >2012-08-05 15:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Checking autorecoverable hosts done >2012-08-05 15:25:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Checking autorecoverable storage domains >2012-08-05 15:25:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Autorecovering 0 storage domains >2012-08-05 15:25:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Checking autorecoverable storage domains done >2012-08-05 15:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [327cc900] Checking autorecoverable hosts >2012-08-05 15:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [327cc900] Autorecovering 0 hosts >2012-08-05 15:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [327cc900] Checking autorecoverable hosts done >2012-08-05 15:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [327cc900] Checking autorecoverable storage domains >2012-08-05 15:30:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [327cc900] Autorecovering 0 storage domains >2012-08-05 15:30:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [327cc900] Checking autorecoverable storage domains done >2012-08-05 15:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) Checking autorecoverable hosts >2012-08-05 15:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) Autorecovering 0 hosts >2012-08-05 15:35:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) Checking autorecoverable hosts done >2012-08-05 15:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) Checking autorecoverable storage domains >2012-08-05 15:35:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) Autorecovering 0 storage domains >2012-08-05 15:35:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) Checking autorecoverable storage domains done >2012-08-05 15:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts >2012-08-05 15:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering 0 hosts >2012-08-05 15:40:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts done >2012-08-05 15:40:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable storage domains >2012-08-05 15:40:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering 0 storage domains >2012-08-05 15:40:00,022 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable storage domains done >2012-08-05 15:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Checking autorecoverable hosts >2012-08-05 15:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Autorecovering 0 hosts >2012-08-05 15:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Checking autorecoverable hosts done >2012-08-05 15:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Checking autorecoverable storage domains >2012-08-05 15:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Autorecovering 0 storage domains >2012-08-05 15:45:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Checking autorecoverable storage domains done >2012-08-05 15:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Checking autorecoverable hosts >2012-08-05 15:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Autorecovering 0 hosts >2012-08-05 15:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Checking autorecoverable hosts done >2012-08-05 15:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Checking autorecoverable storage domains >2012-08-05 15:50:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Autorecovering 0 storage domains >2012-08-05 15:50:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Checking autorecoverable storage domains done >2012-08-05 15:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable hosts >2012-08-05 15:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering 0 hosts >2012-08-05 15:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable hosts done >2012-08-05 15:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable storage domains >2012-08-05 15:55:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering 0 storage domains >2012-08-05 15:55:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable storage domains done >2012-08-05 16:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Checking autorecoverable hosts >2012-08-05 16:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Autorecovering 0 hosts >2012-08-05 16:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Checking autorecoverable hosts done >2012-08-05 16:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Checking autorecoverable storage domains >2012-08-05 16:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Autorecovering 0 storage domains >2012-08-05 16:00:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Checking autorecoverable storage domains done >2012-08-05 16:02:26,439 INFO [org.ovirt.engine.core.bll.storage.AddEmptyStoragePoolCommand] (ajp--127.0.0.1-8009-3) [281eb7cd] Running command: AddEmptyStoragePoolCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-05 16:02:30,515 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-8) START, GetDeviceListVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storageType=ISCSI), log id: 4b7f14be >2012-08-05 16:02:32,688 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-8) FINISH, GetDeviceListVDSCommand, return: [], log id: 4b7f14be >2012-08-05 16:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [327cc900] Checking autorecoverable hosts >2012-08-05 16:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [327cc900] Autorecovering 0 hosts >2012-08-05 16:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [327cc900] Checking autorecoverable hosts done >2012-08-05 16:05:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [327cc900] Checking autorecoverable storage domains >2012-08-05 16:05:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [327cc900] Autorecovering 0 storage domains >2012-08-05 16:05:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [327cc900] Checking autorecoverable storage domains done >2012-08-05 16:09:55,593 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-28) DbUserCacheManager::refreshAllUserData() - entered >2012-08-05 16:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable hosts >2012-08-05 16:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Autorecovering 0 hosts >2012-08-05 16:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable hosts done >2012-08-05 16:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable storage domains >2012-08-05 16:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Autorecovering 0 storage domains >2012-08-05 16:10:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable storage domains done >2012-08-05 16:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Checking autorecoverable hosts >2012-08-05 16:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Autorecovering 0 hosts >2012-08-05 16:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Checking autorecoverable hosts done >2012-08-05 16:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Checking autorecoverable storage domains >2012-08-05 16:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Autorecovering 0 storage domains >2012-08-05 16:15:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Checking autorecoverable storage domains done >2012-08-05 16:17:15,999 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-7) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 7bcfc995 >2012-08-05 16:17:17,152 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-7) FINISH, GetDeviceListVDSCommand, return: [], log id: 7bcfc995 >2012-08-05 16:17:20,031 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-6) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 4196d695 >2012-08-05 16:17:20,833 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-6) FINISH, GetDeviceListVDSCommand, return: [], log id: 4196d695 >2012-08-05 16:17:29,612 INFO [org.ovirt.engine.core.bll.storage.AddEmptyStoragePoolCommand] (ajp--127.0.0.1-8009-8) [467ea717] Running command: AddEmptyStoragePoolCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-05 16:17:42,140 INFO [org.ovirt.engine.core.bll.storage.AddEmptyStoragePoolCommand] (ajp--127.0.0.1-8009-7) [61db1367] Running command: AddEmptyStoragePoolCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-05 16:17:44,975 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-7) START, GetDeviceListVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storageType=ISCSI), log id: 4cf87db9 >2012-08-05 16:17:47,149 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-7) FINISH, GetDeviceListVDSCommand, return: [], log id: 4cf87db9 >2012-08-05 16:17:49,697 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-1) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 3405661 >2012-08-05 16:17:50,630 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-1) FINISH, GetDeviceListVDSCommand, return: [], log id: 3405661 >2012-08-05 16:19:03,987 INFO [org.ovirt.engine.core.bll.storage.AddEmptyStoragePoolCommand] (ajp--127.0.0.1-8009-7) [2ff7d314] Running command: AddEmptyStoragePoolCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-05 16:19:14,239 INFO [org.ovirt.engine.core.bll.storage.AddEmptyStoragePoolCommand] (ajp--127.0.0.1-8009-7) [7ebe0340] Running command: AddEmptyStoragePoolCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-05 16:19:17,798 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-11) START, GetDeviceListVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storageType=ISCSI), log id: 21b19af4 >2012-08-05 16:19:19,952 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-11) FINISH, GetDeviceListVDSCommand, return: [], log id: 21b19af4 >2012-08-05 16:19:21,495 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-7) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 6a43590c >2012-08-05 16:19:22,491 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-7) FINISH, GetDeviceListVDSCommand, return: [], log id: 6a43590c >2012-08-05 16:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable hosts >2012-08-05 16:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Autorecovering 0 hosts >2012-08-05 16:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable hosts done >2012-08-05 16:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable storage domains >2012-08-05 16:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Autorecovering 0 storage domains >2012-08-05 16:20:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable storage domains done >2012-08-05 16:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts >2012-08-05 16:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering 0 hosts >2012-08-05 16:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts done >2012-08-05 16:25:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable storage domains >2012-08-05 16:25:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering 0 storage domains >2012-08-05 16:25:00,021 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable storage domains done >2012-08-05 16:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable hosts >2012-08-05 16:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Autorecovering 0 hosts >2012-08-05 16:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable hosts done >2012-08-05 16:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable storage domains >2012-08-05 16:30:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Autorecovering 0 storage domains >2012-08-05 16:30:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable storage domains done >2012-08-05 16:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) Checking autorecoverable hosts >2012-08-05 16:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) Autorecovering 0 hosts >2012-08-05 16:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) Checking autorecoverable hosts done >2012-08-05 16:35:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) Checking autorecoverable storage domains >2012-08-05 16:35:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) Autorecovering 0 storage domains >2012-08-05 16:35:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) Checking autorecoverable storage domains done >2012-08-05 16:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Checking autorecoverable hosts >2012-08-05 16:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Autorecovering 0 hosts >2012-08-05 16:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Checking autorecoverable hosts done >2012-08-05 16:40:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Checking autorecoverable storage domains >2012-08-05 16:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Autorecovering 0 storage domains >2012-08-05 16:40:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Checking autorecoverable storage domains done >2012-08-05 16:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable hosts >2012-08-05 16:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Autorecovering 0 hosts >2012-08-05 16:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable hosts done >2012-08-05 16:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable storage domains >2012-08-05 16:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Autorecovering 0 storage domains >2012-08-05 16:45:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable storage domains done >2012-08-05 16:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) Checking autorecoverable hosts >2012-08-05 16:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) Autorecovering 0 hosts >2012-08-05 16:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) Checking autorecoverable hosts done >2012-08-05 16:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) Checking autorecoverable storage domains >2012-08-05 16:50:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) Autorecovering 0 storage domains >2012-08-05 16:50:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) Checking autorecoverable storage domains done >2012-08-05 16:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Checking autorecoverable hosts >2012-08-05 16:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Autorecovering 0 hosts >2012-08-05 16:55:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Checking autorecoverable hosts done >2012-08-05 16:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Checking autorecoverable storage domains >2012-08-05 16:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Autorecovering 0 storage domains >2012-08-05 16:55:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Checking autorecoverable storage domains done >2012-08-05 17:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable hosts >2012-08-05 17:00:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Autorecovering 0 hosts >2012-08-05 17:00:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable hosts done >2012-08-05 17:00:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable storage domains >2012-08-05 17:00:00,032 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Autorecovering 0 storage domains >2012-08-05 17:00:00,040 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable storage domains done >2012-08-05 17:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) Checking autorecoverable hosts >2012-08-05 17:05:00,035 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) Autorecovering 0 hosts >2012-08-05 17:05:00,036 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) Checking autorecoverable hosts done >2012-08-05 17:05:00,039 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) Checking autorecoverable storage domains >2012-08-05 17:05:00,042 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) Autorecovering 0 storage domains >2012-08-05 17:05:00,045 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) Checking autorecoverable storage domains done >2012-08-05 17:09:55,596 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-53) DbUserCacheManager::refreshAllUserData() - entered >2012-08-05 17:09:56,083 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp--127.0.0.1-8009-12) [4aed555c] Running command: LogoutUserCommand internal: false. >2012-08-05 17:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable hosts >2012-08-05 17:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Autorecovering 0 hosts >2012-08-05 17:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable hosts done >2012-08-05 17:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable storage domains >2012-08-05 17:10:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Autorecovering 0 storage domains >2012-08-05 17:10:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable storage domains done >2012-08-05 17:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) Checking autorecoverable hosts >2012-08-05 17:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) Autorecovering 0 hosts >2012-08-05 17:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) Checking autorecoverable hosts done >2012-08-05 17:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) Checking autorecoverable storage domains >2012-08-05 17:15:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) Autorecovering 0 storage domains >2012-08-05 17:15:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) Checking autorecoverable storage domains done >2012-08-05 17:18:01,225 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-11) Checking if user admin@internal is an admin, result true >2012-08-05 17:18:01,226 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-11) Running command: LoginAdminUserCommand internal: false. >2012-08-05 17:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Checking autorecoverable hosts >2012-08-05 17:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Autorecovering 0 hosts >2012-08-05 17:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Checking autorecoverable hosts done >2012-08-05 17:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Checking autorecoverable storage domains >2012-08-05 17:20:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Autorecovering 0 storage domains >2012-08-05 17:20:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Checking autorecoverable storage domains done >2012-08-05 17:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Checking autorecoverable hosts >2012-08-05 17:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Autorecovering 0 hosts >2012-08-05 17:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Checking autorecoverable hosts done >2012-08-05 17:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Checking autorecoverable storage domains >2012-08-05 17:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Autorecovering 0 storage domains >2012-08-05 17:25:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Checking autorecoverable storage domains done >2012-08-05 17:28:51,670 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-3) START, GetDeviceListVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storageType=ISCSI), log id: 66122a24 >2012-08-05 17:28:53,821 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-3) FINISH, GetDeviceListVDSCommand, return: [], log id: 66122a24 >2012-08-05 17:29:12,122 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-9) START, GetDeviceListVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storageType=ISCSI), log id: 7e19f6db >2012-08-05 17:29:14,296 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-9) FINISH, GetDeviceListVDSCommand, return: [], log id: 7e19f6db >2012-08-05 17:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Checking autorecoverable hosts >2012-08-05 17:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Autorecovering 0 hosts >2012-08-05 17:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Checking autorecoverable hosts done >2012-08-05 17:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Checking autorecoverable storage domains >2012-08-05 17:30:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Autorecovering 0 storage domains >2012-08-05 17:30:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Checking autorecoverable storage domains done >2012-08-05 17:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Checking autorecoverable hosts >2012-08-05 17:35:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Autorecovering 0 hosts >2012-08-05 17:35:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Checking autorecoverable hosts done >2012-08-05 17:35:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Checking autorecoverable storage domains >2012-08-05 17:35:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Autorecovering 0 storage domains >2012-08-05 17:35:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Checking autorecoverable storage domains done >2012-08-05 17:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable hosts >2012-08-05 17:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Autorecovering 0 hosts >2012-08-05 17:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable hosts done >2012-08-05 17:40:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable storage domains >2012-08-05 17:40:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Autorecovering 0 storage domains >2012-08-05 17:40:00,022 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable storage domains done >2012-08-05 17:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts >2012-08-05 17:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering 0 hosts >2012-08-05 17:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts done >2012-08-05 17:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable storage domains >2012-08-05 17:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering 0 storage domains >2012-08-05 17:45:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable storage domains done >2012-08-05 17:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Checking autorecoverable hosts >2012-08-05 17:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Autorecovering 0 hosts >2012-08-05 17:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Checking autorecoverable hosts done >2012-08-05 17:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Checking autorecoverable storage domains >2012-08-05 17:50:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Autorecovering 0 storage domains >2012-08-05 17:50:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Checking autorecoverable storage domains done >2012-08-05 17:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) Checking autorecoverable hosts >2012-08-05 17:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) Autorecovering 0 hosts >2012-08-05 17:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) Checking autorecoverable hosts done >2012-08-05 17:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) Checking autorecoverable storage domains >2012-08-05 17:55:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) Autorecovering 0 storage domains >2012-08-05 17:55:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) Checking autorecoverable storage domains done >2012-08-05 18:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Checking autorecoverable hosts >2012-08-05 18:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Autorecovering 0 hosts >2012-08-05 18:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Checking autorecoverable hosts done >2012-08-05 18:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Checking autorecoverable storage domains >2012-08-05 18:00:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Autorecovering 0 storage domains >2012-08-05 18:00:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Checking autorecoverable storage domains done >2012-08-05 18:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Checking autorecoverable hosts >2012-08-05 18:05:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Autorecovering 0 hosts >2012-08-05 18:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Checking autorecoverable hosts done >2012-08-05 18:05:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Checking autorecoverable storage domains >2012-08-05 18:05:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Autorecovering 0 storage domains >2012-08-05 18:05:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Checking autorecoverable storage domains done >2012-08-05 18:09:55,597 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-54) DbUserCacheManager::refreshAllUserData() - entered >2012-08-05 18:09:56,896 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp--127.0.0.1-8009-12) [66c3cc37] Running command: LogoutUserCommand internal: false. >2012-08-05 18:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable hosts >2012-08-05 18:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Autorecovering 0 hosts >2012-08-05 18:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable hosts done >2012-08-05 18:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable storage domains >2012-08-05 18:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Autorecovering 0 storage domains >2012-08-05 18:10:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable storage domains done >2012-08-05 18:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable hosts >2012-08-05 18:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Autorecovering 0 hosts >2012-08-05 18:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable hosts done >2012-08-05 18:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable storage domains >2012-08-05 18:15:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Autorecovering 0 storage domains >2012-08-05 18:15:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable storage domains done >2012-08-05 18:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable hosts >2012-08-05 18:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Autorecovering 0 hosts >2012-08-05 18:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable hosts done >2012-08-05 18:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable storage domains >2012-08-05 18:20:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Autorecovering 0 storage domains >2012-08-05 18:20:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable storage domains done >2012-08-05 18:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Checking autorecoverable hosts >2012-08-05 18:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Autorecovering 0 hosts >2012-08-05 18:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Checking autorecoverable hosts done >2012-08-05 18:25:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Checking autorecoverable storage domains >2012-08-05 18:25:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Autorecovering 0 storage domains >2012-08-05 18:25:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Checking autorecoverable storage domains done >2012-08-05 18:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) Checking autorecoverable hosts >2012-08-05 18:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) Autorecovering 0 hosts >2012-08-05 18:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) Checking autorecoverable hosts done >2012-08-05 18:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) Checking autorecoverable storage domains >2012-08-05 18:30:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) Autorecovering 0 storage domains >2012-08-05 18:30:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) Checking autorecoverable storage domains done >2012-08-05 18:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Checking autorecoverable hosts >2012-08-05 18:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Autorecovering 0 hosts >2012-08-05 18:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Checking autorecoverable hosts done >2012-08-05 18:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Checking autorecoverable storage domains >2012-08-05 18:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Autorecovering 0 storage domains >2012-08-05 18:35:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Checking autorecoverable storage domains done >2012-08-05 18:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Checking autorecoverable hosts >2012-08-05 18:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Autorecovering 0 hosts >2012-08-05 18:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Checking autorecoverable hosts done >2012-08-05 18:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Checking autorecoverable storage domains >2012-08-05 18:40:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Autorecovering 0 storage domains >2012-08-05 18:40:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Checking autorecoverable storage domains done >2012-08-05 18:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Checking autorecoverable hosts >2012-08-05 18:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Autorecovering 0 hosts >2012-08-05 18:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Checking autorecoverable hosts done >2012-08-05 18:45:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Checking autorecoverable storage domains >2012-08-05 18:45:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Autorecovering 0 storage domains >2012-08-05 18:45:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Checking autorecoverable storage domains done >2012-08-05 18:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable hosts >2012-08-05 18:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Autorecovering 0 hosts >2012-08-05 18:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable hosts done >2012-08-05 18:50:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable storage domains >2012-08-05 18:50:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Autorecovering 0 storage domains >2012-08-05 18:50:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable storage domains done >2012-08-05 18:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable hosts >2012-08-05 18:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Autorecovering 0 hosts >2012-08-05 18:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable hosts done >2012-08-05 18:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable storage domains >2012-08-05 18:55:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Autorecovering 0 storage domains >2012-08-05 18:55:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable storage domains done >2012-08-05 19:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) Checking autorecoverable hosts >2012-08-05 19:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) Autorecovering 0 hosts >2012-08-05 19:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) Checking autorecoverable hosts done >2012-08-05 19:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) Checking autorecoverable storage domains >2012-08-05 19:00:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) Autorecovering 0 storage domains >2012-08-05 19:00:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) Checking autorecoverable storage domains done >2012-08-05 19:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Checking autorecoverable hosts >2012-08-05 19:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Autorecovering 0 hosts >2012-08-05 19:05:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Checking autorecoverable hosts done >2012-08-05 19:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Checking autorecoverable storage domains >2012-08-05 19:05:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Autorecovering 0 storage domains >2012-08-05 19:05:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Checking autorecoverable storage domains done >2012-08-05 19:09:55,600 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-7) DbUserCacheManager::refreshAllUserData() - entered >2012-08-05 19:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable hosts >2012-08-05 19:10:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Autorecovering 0 hosts >2012-08-05 19:10:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable hosts done >2012-08-05 19:10:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable storage domains >2012-08-05 19:10:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Autorecovering 0 storage domains >2012-08-05 19:10:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable storage domains done >2012-08-05 19:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Checking autorecoverable hosts >2012-08-05 19:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Autorecovering 0 hosts >2012-08-05 19:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Checking autorecoverable hosts done >2012-08-05 19:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Checking autorecoverable storage domains >2012-08-05 19:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Autorecovering 0 storage domains >2012-08-05 19:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Checking autorecoverable storage domains done >2012-08-05 19:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable hosts >2012-08-05 19:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Autorecovering 0 hosts >2012-08-05 19:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable hosts done >2012-08-05 19:20:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable storage domains >2012-08-05 19:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Autorecovering 0 storage domains >2012-08-05 19:20:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable storage domains done >2012-08-05 19:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable hosts >2012-08-05 19:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Autorecovering 0 hosts >2012-08-05 19:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable hosts done >2012-08-05 19:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable storage domains >2012-08-05 19:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Autorecovering 0 storage domains >2012-08-05 19:25:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable storage domains done >2012-08-05 19:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable hosts >2012-08-05 19:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Autorecovering 0 hosts >2012-08-05 19:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable hosts done >2012-08-05 19:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable storage domains >2012-08-05 19:30:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Autorecovering 0 storage domains >2012-08-05 19:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable storage domains done >2012-08-05 19:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable hosts >2012-08-05 19:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Autorecovering 0 hosts >2012-08-05 19:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable hosts done >2012-08-05 19:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable storage domains >2012-08-05 19:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Autorecovering 0 storage domains >2012-08-05 19:35:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable storage domains done >2012-08-05 19:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Checking autorecoverable hosts >2012-08-05 19:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Autorecovering 0 hosts >2012-08-05 19:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Checking autorecoverable hosts done >2012-08-05 19:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Checking autorecoverable storage domains >2012-08-05 19:40:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Autorecovering 0 storage domains >2012-08-05 19:40:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Checking autorecoverable storage domains done >2012-08-05 19:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Checking autorecoverable hosts >2012-08-05 19:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Autorecovering 0 hosts >2012-08-05 19:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Checking autorecoverable hosts done >2012-08-05 19:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Checking autorecoverable storage domains >2012-08-05 19:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Autorecovering 0 storage domains >2012-08-05 19:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Checking autorecoverable storage domains done >2012-08-05 19:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable hosts >2012-08-05 19:50:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Autorecovering 0 hosts >2012-08-05 19:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable hosts done >2012-08-05 19:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable storage domains >2012-08-05 19:50:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Autorecovering 0 storage domains >2012-08-05 19:50:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable storage domains done >2012-08-05 19:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Checking autorecoverable hosts >2012-08-05 19:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Autorecovering 0 hosts >2012-08-05 19:55:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Checking autorecoverable hosts done >2012-08-05 19:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Checking autorecoverable storage domains >2012-08-05 19:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Autorecovering 0 storage domains >2012-08-05 19:55:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Checking autorecoverable storage domains done >2012-08-05 20:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable hosts >2012-08-05 20:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Autorecovering 0 hosts >2012-08-05 20:00:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable hosts done >2012-08-05 20:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable storage domains >2012-08-05 20:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Autorecovering 0 storage domains >2012-08-05 20:00:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable storage domains done >2012-08-05 20:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable hosts >2012-08-05 20:05:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Autorecovering 0 hosts >2012-08-05 20:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable hosts done >2012-08-05 20:05:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable storage domains >2012-08-05 20:05:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Autorecovering 0 storage domains >2012-08-05 20:05:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable storage domains done >2012-08-05 20:09:55,607 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-80) DbUserCacheManager::refreshAllUserData() - entered >2012-08-05 20:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable hosts >2012-08-05 20:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Autorecovering 0 hosts >2012-08-05 20:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable hosts done >2012-08-05 20:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable storage domains >2012-08-05 20:10:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Autorecovering 0 storage domains >2012-08-05 20:10:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable storage domains done >2012-08-05 20:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) Checking autorecoverable hosts >2012-08-05 20:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) Autorecovering 0 hosts >2012-08-05 20:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) Checking autorecoverable hosts done >2012-08-05 20:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) Checking autorecoverable storage domains >2012-08-05 20:15:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) Autorecovering 0 storage domains >2012-08-05 20:15:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) Checking autorecoverable storage domains done >2012-08-05 20:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable hosts >2012-08-05 20:20:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Autorecovering 0 hosts >2012-08-05 20:20:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable hosts done >2012-08-05 20:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable storage domains >2012-08-05 20:20:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Autorecovering 0 storage domains >2012-08-05 20:20:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable storage domains done >2012-08-05 20:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts >2012-08-05 20:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering 0 hosts >2012-08-05 20:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts done >2012-08-05 20:25:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable storage domains >2012-08-05 20:25:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering 0 storage domains >2012-08-05 20:25:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable storage domains done >2012-08-05 20:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Checking autorecoverable hosts >2012-08-05 20:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Autorecovering 0 hosts >2012-08-05 20:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Checking autorecoverable hosts done >2012-08-05 20:30:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Checking autorecoverable storage domains >2012-08-05 20:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Autorecovering 0 storage domains >2012-08-05 20:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Checking autorecoverable storage domains done >2012-08-05 20:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Checking autorecoverable hosts >2012-08-05 20:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Autorecovering 0 hosts >2012-08-05 20:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Checking autorecoverable hosts done >2012-08-05 20:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Checking autorecoverable storage domains >2012-08-05 20:35:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Autorecovering 0 storage domains >2012-08-05 20:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Checking autorecoverable storage domains done >2012-08-05 20:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable hosts >2012-08-05 20:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Autorecovering 0 hosts >2012-08-05 20:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable hosts done >2012-08-05 20:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable storage domains >2012-08-05 20:40:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Autorecovering 0 storage domains >2012-08-05 20:40:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable storage domains done >2012-08-05 20:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Checking autorecoverable hosts >2012-08-05 20:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Autorecovering 0 hosts >2012-08-05 20:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Checking autorecoverable hosts done >2012-08-05 20:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Checking autorecoverable storage domains >2012-08-05 20:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Autorecovering 0 storage domains >2012-08-05 20:45:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Checking autorecoverable storage domains done >2012-08-05 20:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) Checking autorecoverable hosts >2012-08-05 20:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) Autorecovering 0 hosts >2012-08-05 20:50:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) Checking autorecoverable hosts done >2012-08-05 20:50:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) Checking autorecoverable storage domains >2012-08-05 20:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) Autorecovering 0 storage domains >2012-08-05 20:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) Checking autorecoverable storage domains done >2012-08-05 20:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable hosts >2012-08-05 20:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Autorecovering 0 hosts >2012-08-05 20:55:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable hosts done >2012-08-05 20:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable storage domains >2012-08-05 20:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Autorecovering 0 storage domains >2012-08-05 20:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable storage domains done >2012-08-05 21:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts >2012-08-05 21:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering 0 hosts >2012-08-05 21:00:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts done >2012-08-05 21:00:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable storage domains >2012-08-05 21:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering 0 storage domains >2012-08-05 21:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable storage domains done >2012-08-05 21:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-70) Checking autorecoverable hosts >2012-08-05 21:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-70) Autorecovering 0 hosts >2012-08-05 21:05:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-70) Checking autorecoverable hosts done >2012-08-05 21:05:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-70) Checking autorecoverable storage domains >2012-08-05 21:05:00,042 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-70) Autorecovering 0 storage domains >2012-08-05 21:05:00,045 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-70) Checking autorecoverable storage domains done >2012-08-05 21:09:55,610 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-26) DbUserCacheManager::refreshAllUserData() - entered >2012-08-05 21:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) Checking autorecoverable hosts >2012-08-05 21:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) Autorecovering 0 hosts >2012-08-05 21:10:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) Checking autorecoverable hosts done >2012-08-05 21:10:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) Checking autorecoverable storage domains >2012-08-05 21:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) Autorecovering 0 storage domains >2012-08-05 21:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) Checking autorecoverable storage domains done >2012-08-05 21:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Checking autorecoverable hosts >2012-08-05 21:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Autorecovering 0 hosts >2012-08-05 21:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Checking autorecoverable hosts done >2012-08-05 21:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Checking autorecoverable storage domains >2012-08-05 21:15:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Autorecovering 0 storage domains >2012-08-05 21:15:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Checking autorecoverable storage domains done >2012-08-05 21:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Checking autorecoverable hosts >2012-08-05 21:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Autorecovering 0 hosts >2012-08-05 21:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Checking autorecoverable hosts done >2012-08-05 21:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Checking autorecoverable storage domains >2012-08-05 21:20:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Autorecovering 0 storage domains >2012-08-05 21:20:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Checking autorecoverable storage domains done >2012-08-05 21:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Checking autorecoverable hosts >2012-08-05 21:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Autorecovering 0 hosts >2012-08-05 21:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Checking autorecoverable hosts done >2012-08-05 21:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Checking autorecoverable storage domains >2012-08-05 21:25:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Autorecovering 0 storage domains >2012-08-05 21:25:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Checking autorecoverable storage domains done >2012-08-05 21:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Checking autorecoverable hosts >2012-08-05 21:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Autorecovering 0 hosts >2012-08-05 21:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Checking autorecoverable hosts done >2012-08-05 21:30:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Checking autorecoverable storage domains >2012-08-05 21:30:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Autorecovering 0 storage domains >2012-08-05 21:30:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Checking autorecoverable storage domains done >2012-08-05 21:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Checking autorecoverable hosts >2012-08-05 21:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Autorecovering 0 hosts >2012-08-05 21:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Checking autorecoverable hosts done >2012-08-05 21:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Checking autorecoverable storage domains >2012-08-05 21:35:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Autorecovering 0 storage domains >2012-08-05 21:35:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Checking autorecoverable storage domains done >2012-08-05 21:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable hosts >2012-08-05 21:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Autorecovering 0 hosts >2012-08-05 21:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable hosts done >2012-08-05 21:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable storage domains >2012-08-05 21:40:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Autorecovering 0 storage domains >2012-08-05 21:40:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable storage domains done >2012-08-05 21:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable hosts >2012-08-05 21:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Autorecovering 0 hosts >2012-08-05 21:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable hosts done >2012-08-05 21:45:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable storage domains >2012-08-05 21:45:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Autorecovering 0 storage domains >2012-08-05 21:45:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable storage domains done >2012-08-05 21:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts >2012-08-05 21:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering 0 hosts >2012-08-05 21:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts done >2012-08-05 21:50:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable storage domains >2012-08-05 21:50:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering 0 storage domains >2012-08-05 21:50:00,021 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable storage domains done >2012-08-05 21:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Checking autorecoverable hosts >2012-08-05 21:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Autorecovering 0 hosts >2012-08-05 21:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Checking autorecoverable hosts done >2012-08-05 21:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Checking autorecoverable storage domains >2012-08-05 21:55:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Autorecovering 0 storage domains >2012-08-05 21:55:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Checking autorecoverable storage domains done >2012-08-05 22:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable hosts >2012-08-05 22:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Autorecovering 0 hosts >2012-08-05 22:00:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable hosts done >2012-08-05 22:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable storage domains >2012-08-05 22:00:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Autorecovering 0 storage domains >2012-08-05 22:00:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable storage domains done >2012-08-05 22:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) Checking autorecoverable hosts >2012-08-05 22:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) Autorecovering 0 hosts >2012-08-05 22:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) Checking autorecoverable hosts done >2012-08-05 22:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) Checking autorecoverable storage domains >2012-08-05 22:05:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) Autorecovering 0 storage domains >2012-08-05 22:05:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) Checking autorecoverable storage domains done >2012-08-05 22:09:55,613 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-75) DbUserCacheManager::refreshAllUserData() - entered >2012-08-05 22:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable hosts >2012-08-05 22:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Autorecovering 0 hosts >2012-08-05 22:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable hosts done >2012-08-05 22:10:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable storage domains >2012-08-05 22:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Autorecovering 0 storage domains >2012-08-05 22:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable storage domains done >2012-08-05 22:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Checking autorecoverable hosts >2012-08-05 22:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Autorecovering 0 hosts >2012-08-05 22:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Checking autorecoverable hosts done >2012-08-05 22:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Checking autorecoverable storage domains >2012-08-05 22:15:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Autorecovering 0 storage domains >2012-08-05 22:15:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Checking autorecoverable storage domains done >2012-08-05 22:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable hosts >2012-08-05 22:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Autorecovering 0 hosts >2012-08-05 22:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable hosts done >2012-08-05 22:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable storage domains >2012-08-05 22:20:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Autorecovering 0 storage domains >2012-08-05 22:20:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable storage domains done >2012-08-05 22:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Checking autorecoverable hosts >2012-08-05 22:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Autorecovering 0 hosts >2012-08-05 22:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Checking autorecoverable hosts done >2012-08-05 22:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Checking autorecoverable storage domains >2012-08-05 22:25:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Autorecovering 0 storage domains >2012-08-05 22:25:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Checking autorecoverable storage domains done >2012-08-05 22:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts >2012-08-05 22:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering 0 hosts >2012-08-05 22:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts done >2012-08-05 22:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable storage domains >2012-08-05 22:30:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering 0 storage domains >2012-08-05 22:30:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable storage domains done >2012-08-05 22:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Checking autorecoverable hosts >2012-08-05 22:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Autorecovering 0 hosts >2012-08-05 22:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Checking autorecoverable hosts done >2012-08-05 22:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Checking autorecoverable storage domains >2012-08-05 22:35:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Autorecovering 0 storage domains >2012-08-05 22:35:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Checking autorecoverable storage domains done >2012-08-05 22:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-53) Checking autorecoverable hosts >2012-08-05 22:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-53) Autorecovering 0 hosts >2012-08-05 22:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-53) Checking autorecoverable hosts done >2012-08-05 22:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-53) Checking autorecoverable storage domains >2012-08-05 22:40:00,351 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-53) Autorecovering 0 storage domains >2012-08-05 22:40:00,352 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-53) Checking autorecoverable storage domains done >2012-08-05 22:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable hosts >2012-08-05 22:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Autorecovering 0 hosts >2012-08-05 22:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable hosts done >2012-08-05 22:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable storage domains >2012-08-05 22:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Autorecovering 0 storage domains >2012-08-05 22:45:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable storage domains done >2012-08-05 22:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable hosts >2012-08-05 22:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Autorecovering 0 hosts >2012-08-05 22:50:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable hosts done >2012-08-05 22:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable storage domains >2012-08-05 22:50:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Autorecovering 0 storage domains >2012-08-05 22:50:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable storage domains done >2012-08-05 22:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Checking autorecoverable hosts >2012-08-05 22:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Autorecovering 0 hosts >2012-08-05 22:55:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Checking autorecoverable hosts done >2012-08-05 22:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Checking autorecoverable storage domains >2012-08-05 22:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Autorecovering 0 storage domains >2012-08-05 22:55:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Checking autorecoverable storage domains done >2012-08-05 23:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable hosts >2012-08-05 23:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Autorecovering 0 hosts >2012-08-05 23:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable hosts done >2012-08-05 23:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable storage domains >2012-08-05 23:00:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Autorecovering 0 storage domains >2012-08-05 23:00:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable storage domains done >2012-08-05 23:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable hosts >2012-08-05 23:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Autorecovering 0 hosts >2012-08-05 23:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable hosts done >2012-08-05 23:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable storage domains >2012-08-05 23:05:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Autorecovering 0 storage domains >2012-08-05 23:05:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable storage domains done >2012-08-05 23:09:55,615 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-15) DbUserCacheManager::refreshAllUserData() - entered >2012-08-05 23:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable hosts >2012-08-05 23:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Autorecovering 0 hosts >2012-08-05 23:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable hosts done >2012-08-05 23:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable storage domains >2012-08-05 23:10:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Autorecovering 0 storage domains >2012-08-05 23:10:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable storage domains done >2012-08-05 23:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts >2012-08-05 23:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering 0 hosts >2012-08-05 23:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts done >2012-08-05 23:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable storage domains >2012-08-05 23:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering 0 storage domains >2012-08-05 23:15:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable storage domains done >2012-08-05 23:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Checking autorecoverable hosts >2012-08-05 23:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Autorecovering 0 hosts >2012-08-05 23:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Checking autorecoverable hosts done >2012-08-05 23:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Checking autorecoverable storage domains >2012-08-05 23:20:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Autorecovering 0 storage domains >2012-08-05 23:20:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Checking autorecoverable storage domains done >2012-08-05 23:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable hosts >2012-08-05 23:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Autorecovering 0 hosts >2012-08-05 23:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable hosts done >2012-08-05 23:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable storage domains >2012-08-05 23:25:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Autorecovering 0 storage domains >2012-08-05 23:25:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable storage domains done >2012-08-05 23:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable hosts >2012-08-05 23:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Autorecovering 0 hosts >2012-08-05 23:30:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable hosts done >2012-08-05 23:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable storage domains >2012-08-05 23:30:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Autorecovering 0 storage domains >2012-08-05 23:30:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable storage domains done >2012-08-05 23:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable hosts >2012-08-05 23:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Autorecovering 0 hosts >2012-08-05 23:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable hosts done >2012-08-05 23:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable storage domains >2012-08-05 23:35:00,048 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Autorecovering 0 storage domains >2012-08-05 23:35:00,050 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable storage domains done >2012-08-05 23:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable hosts >2012-08-05 23:40:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Autorecovering 0 hosts >2012-08-05 23:40:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable hosts done >2012-08-05 23:40:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable storage domains >2012-08-05 23:40:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Autorecovering 0 storage domains >2012-08-05 23:40:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable storage domains done >2012-08-05 23:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Checking autorecoverable hosts >2012-08-05 23:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Autorecovering 0 hosts >2012-08-05 23:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Checking autorecoverable hosts done >2012-08-05 23:45:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Checking autorecoverable storage domains >2012-08-05 23:45:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Autorecovering 0 storage domains >2012-08-05 23:45:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Checking autorecoverable storage domains done >2012-08-05 23:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable hosts >2012-08-05 23:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Autorecovering 0 hosts >2012-08-05 23:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable hosts done >2012-08-05 23:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable storage domains >2012-08-05 23:50:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Autorecovering 0 storage domains >2012-08-05 23:50:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable storage domains done >2012-08-05 23:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable hosts >2012-08-05 23:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Autorecovering 0 hosts >2012-08-05 23:55:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable hosts done >2012-08-05 23:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable storage domains >2012-08-05 23:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Autorecovering 0 storage domains >2012-08-05 23:55:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable storage domains done >2012-08-06 00:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable hosts >2012-08-06 00:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Autorecovering 0 hosts >2012-08-06 00:00:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable hosts done >2012-08-06 00:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable storage domains >2012-08-06 00:00:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Autorecovering 0 storage domains >2012-08-06 00:00:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable storage domains done >2012-08-06 00:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable hosts >2012-08-06 00:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Autorecovering 0 hosts >2012-08-06 00:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable hosts done >2012-08-06 00:05:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable storage domains >2012-08-06 00:05:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Autorecovering 0 storage domains >2012-08-06 00:05:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable storage domains done >2012-08-06 00:09:55,770 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-63) DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 00:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Checking autorecoverable hosts >2012-08-06 00:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Autorecovering 0 hosts >2012-08-06 00:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Checking autorecoverable hosts done >2012-08-06 00:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Checking autorecoverable storage domains >2012-08-06 00:10:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Autorecovering 0 storage domains >2012-08-06 00:10:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Checking autorecoverable storage domains done >2012-08-06 00:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable hosts >2012-08-06 00:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Autorecovering 0 hosts >2012-08-06 00:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable hosts done >2012-08-06 00:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable storage domains >2012-08-06 00:15:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Autorecovering 0 storage domains >2012-08-06 00:15:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable storage domains done >2012-08-06 00:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Checking autorecoverable hosts >2012-08-06 00:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Autorecovering 0 hosts >2012-08-06 00:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Checking autorecoverable hosts done >2012-08-06 00:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Checking autorecoverable storage domains >2012-08-06 00:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Autorecovering 0 storage domains >2012-08-06 00:20:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Checking autorecoverable storage domains done >2012-08-06 00:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable hosts >2012-08-06 00:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Autorecovering 0 hosts >2012-08-06 00:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable hosts done >2012-08-06 00:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable storage domains >2012-08-06 00:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Autorecovering 0 storage domains >2012-08-06 00:25:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable storage domains done >2012-08-06 00:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) Checking autorecoverable hosts >2012-08-06 00:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) Autorecovering 0 hosts >2012-08-06 00:30:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) Checking autorecoverable hosts done >2012-08-06 00:30:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) Checking autorecoverable storage domains >2012-08-06 00:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) Autorecovering 0 storage domains >2012-08-06 00:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) Checking autorecoverable storage domains done >2012-08-06 00:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Checking autorecoverable hosts >2012-08-06 00:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Autorecovering 0 hosts >2012-08-06 00:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Checking autorecoverable hosts done >2012-08-06 00:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Checking autorecoverable storage domains >2012-08-06 00:35:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Autorecovering 0 storage domains >2012-08-06 00:35:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Checking autorecoverable storage domains done >2012-08-06 00:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable hosts >2012-08-06 00:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Autorecovering 0 hosts >2012-08-06 00:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable hosts done >2012-08-06 00:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable storage domains >2012-08-06 00:40:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Autorecovering 0 storage domains >2012-08-06 00:40:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable storage domains done >2012-08-06 00:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable hosts >2012-08-06 00:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Autorecovering 0 hosts >2012-08-06 00:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable hosts done >2012-08-06 00:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable storage domains >2012-08-06 00:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Autorecovering 0 storage domains >2012-08-06 00:45:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable storage domains done >2012-08-06 00:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable hosts >2012-08-06 00:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Autorecovering 0 hosts >2012-08-06 00:50:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable hosts done >2012-08-06 00:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable storage domains >2012-08-06 00:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Autorecovering 0 storage domains >2012-08-06 00:50:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable storage domains done >2012-08-06 00:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Checking autorecoverable hosts >2012-08-06 00:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Autorecovering 0 hosts >2012-08-06 00:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Checking autorecoverable hosts done >2012-08-06 00:55:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Checking autorecoverable storage domains >2012-08-06 00:55:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Autorecovering 0 storage domains >2012-08-06 00:55:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Checking autorecoverable storage domains done >2012-08-06 01:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable hosts >2012-08-06 01:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Autorecovering 0 hosts >2012-08-06 01:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable hosts done >2012-08-06 01:00:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable storage domains >2012-08-06 01:00:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Autorecovering 0 storage domains >2012-08-06 01:00:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable storage domains done >2012-08-06 01:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) Checking autorecoverable hosts >2012-08-06 01:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) Autorecovering 0 hosts >2012-08-06 01:05:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) Checking autorecoverable hosts done >2012-08-06 01:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) Checking autorecoverable storage domains >2012-08-06 01:05:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) Autorecovering 0 storage domains >2012-08-06 01:05:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) Checking autorecoverable storage domains done >2012-08-06 01:09:55,875 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-25) DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 01:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) Checking autorecoverable hosts >2012-08-06 01:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) Autorecovering 0 hosts >2012-08-06 01:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) Checking autorecoverable hosts done >2012-08-06 01:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) Checking autorecoverable storage domains >2012-08-06 01:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) Autorecovering 0 storage domains >2012-08-06 01:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) Checking autorecoverable storage domains done >2012-08-06 01:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable hosts >2012-08-06 01:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Autorecovering 0 hosts >2012-08-06 01:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable hosts done >2012-08-06 01:15:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable storage domains >2012-08-06 01:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Autorecovering 0 storage domains >2012-08-06 01:15:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable storage domains done >2012-08-06 01:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable hosts >2012-08-06 01:20:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Autorecovering 0 hosts >2012-08-06 01:20:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable hosts done >2012-08-06 01:20:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable storage domains >2012-08-06 01:20:00,030 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Autorecovering 0 storage domains >2012-08-06 01:20:00,032 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable storage domains done >2012-08-06 01:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable hosts >2012-08-06 01:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Autorecovering 0 hosts >2012-08-06 01:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable hosts done >2012-08-06 01:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable storage domains >2012-08-06 01:25:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Autorecovering 0 storage domains >2012-08-06 01:25:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable storage domains done >2012-08-06 01:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) Checking autorecoverable hosts >2012-08-06 01:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) Autorecovering 0 hosts >2012-08-06 01:30:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) Checking autorecoverable hosts done >2012-08-06 01:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) Checking autorecoverable storage domains >2012-08-06 01:30:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) Autorecovering 0 storage domains >2012-08-06 01:30:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) Checking autorecoverable storage domains done >2012-08-06 01:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Checking autorecoverable hosts >2012-08-06 01:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Autorecovering 0 hosts >2012-08-06 01:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Checking autorecoverable hosts done >2012-08-06 01:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Checking autorecoverable storage domains >2012-08-06 01:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Autorecovering 0 storage domains >2012-08-06 01:35:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Checking autorecoverable storage domains done >2012-08-06 01:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) Checking autorecoverable hosts >2012-08-06 01:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) Autorecovering 0 hosts >2012-08-06 01:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) Checking autorecoverable hosts done >2012-08-06 01:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) Checking autorecoverable storage domains >2012-08-06 01:40:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) Autorecovering 0 storage domains >2012-08-06 01:40:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) Checking autorecoverable storage domains done >2012-08-06 01:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable hosts >2012-08-06 01:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Autorecovering 0 hosts >2012-08-06 01:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable hosts done >2012-08-06 01:45:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable storage domains >2012-08-06 01:45:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Autorecovering 0 storage domains >2012-08-06 01:45:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable storage domains done >2012-08-06 01:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts >2012-08-06 01:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering 0 hosts >2012-08-06 01:50:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts done >2012-08-06 01:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable storage domains >2012-08-06 01:50:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering 0 storage domains >2012-08-06 01:50:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable storage domains done >2012-08-06 01:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Checking autorecoverable hosts >2012-08-06 01:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Autorecovering 0 hosts >2012-08-06 01:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Checking autorecoverable hosts done >2012-08-06 01:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Checking autorecoverable storage domains >2012-08-06 01:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Autorecovering 0 storage domains >2012-08-06 01:55:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Checking autorecoverable storage domains done >2012-08-06 02:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable hosts >2012-08-06 02:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Autorecovering 0 hosts >2012-08-06 02:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable hosts done >2012-08-06 02:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable storage domains >2012-08-06 02:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Autorecovering 0 storage domains >2012-08-06 02:00:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable storage domains done >2012-08-06 02:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable hosts >2012-08-06 02:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering 0 hosts >2012-08-06 02:05:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable hosts done >2012-08-06 02:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable storage domains >2012-08-06 02:05:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering 0 storage domains >2012-08-06 02:05:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable storage domains done >2012-08-06 02:09:55,879 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-91) DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 02:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Checking autorecoverable hosts >2012-08-06 02:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Autorecovering 0 hosts >2012-08-06 02:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Checking autorecoverable hosts done >2012-08-06 02:10:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Checking autorecoverable storage domains >2012-08-06 02:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Autorecovering 0 storage domains >2012-08-06 02:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Checking autorecoverable storage domains done >2012-08-06 02:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Checking autorecoverable hosts >2012-08-06 02:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Autorecovering 0 hosts >2012-08-06 02:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Checking autorecoverable hosts done >2012-08-06 02:15:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Checking autorecoverable storage domains >2012-08-06 02:15:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Autorecovering 0 storage domains >2012-08-06 02:15:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Checking autorecoverable storage domains done >2012-08-06 02:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Checking autorecoverable hosts >2012-08-06 02:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Autorecovering 0 hosts >2012-08-06 02:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Checking autorecoverable hosts done >2012-08-06 02:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Checking autorecoverable storage domains >2012-08-06 02:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Autorecovering 0 storage domains >2012-08-06 02:20:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Checking autorecoverable storage domains done >2012-08-06 02:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Checking autorecoverable hosts >2012-08-06 02:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Autorecovering 0 hosts >2012-08-06 02:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Checking autorecoverable hosts done >2012-08-06 02:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Checking autorecoverable storage domains >2012-08-06 02:25:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Autorecovering 0 storage domains >2012-08-06 02:25:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Checking autorecoverable storage domains done >2012-08-06 02:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Checking autorecoverable hosts >2012-08-06 02:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Autorecovering 0 hosts >2012-08-06 02:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Checking autorecoverable hosts done >2012-08-06 02:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Checking autorecoverable storage domains >2012-08-06 02:30:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Autorecovering 0 storage domains >2012-08-06 02:30:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Checking autorecoverable storage domains done >2012-08-06 02:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable hosts >2012-08-06 02:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Autorecovering 0 hosts >2012-08-06 02:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable hosts done >2012-08-06 02:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable storage domains >2012-08-06 02:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Autorecovering 0 storage domains >2012-08-06 02:35:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable storage domains done >2012-08-06 02:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Checking autorecoverable hosts >2012-08-06 02:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Autorecovering 0 hosts >2012-08-06 02:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Checking autorecoverable hosts done >2012-08-06 02:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Checking autorecoverable storage domains >2012-08-06 02:40:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Autorecovering 0 storage domains >2012-08-06 02:40:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Checking autorecoverable storage domains done >2012-08-06 02:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Checking autorecoverable hosts >2012-08-06 02:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Autorecovering 0 hosts >2012-08-06 02:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Checking autorecoverable hosts done >2012-08-06 02:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Checking autorecoverable storage domains >2012-08-06 02:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Autorecovering 0 storage domains >2012-08-06 02:45:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Checking autorecoverable storage domains done >2012-08-06 02:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Checking autorecoverable hosts >2012-08-06 02:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Autorecovering 0 hosts >2012-08-06 02:50:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Checking autorecoverable hosts done >2012-08-06 02:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Checking autorecoverable storage domains >2012-08-06 02:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Autorecovering 0 storage domains >2012-08-06 02:50:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Checking autorecoverable storage domains done >2012-08-06 02:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Checking autorecoverable hosts >2012-08-06 02:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Autorecovering 0 hosts >2012-08-06 02:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Checking autorecoverable hosts done >2012-08-06 02:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Checking autorecoverable storage domains >2012-08-06 02:55:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Autorecovering 0 storage domains >2012-08-06 02:55:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Checking autorecoverable storage domains done >2012-08-06 03:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable hosts >2012-08-06 03:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Autorecovering 0 hosts >2012-08-06 03:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable hosts done >2012-08-06 03:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable storage domains >2012-08-06 03:00:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Autorecovering 0 storage domains >2012-08-06 03:00:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable storage domains done >2012-08-06 03:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable hosts >2012-08-06 03:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Autorecovering 0 hosts >2012-08-06 03:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable hosts done >2012-08-06 03:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable storage domains >2012-08-06 03:05:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Autorecovering 0 storage domains >2012-08-06 03:05:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable storage domains done >2012-08-06 03:09:55,919 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-44) DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 03:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable hosts >2012-08-06 03:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Autorecovering 0 hosts >2012-08-06 03:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable hosts done >2012-08-06 03:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable storage domains >2012-08-06 03:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Autorecovering 0 storage domains >2012-08-06 03:10:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable storage domains done >2012-08-06 03:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable hosts >2012-08-06 03:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Autorecovering 0 hosts >2012-08-06 03:15:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable hosts done >2012-08-06 03:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable storage domains >2012-08-06 03:15:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Autorecovering 0 storage domains >2012-08-06 03:15:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable storage domains done >2012-08-06 03:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable hosts >2012-08-06 03:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Autorecovering 0 hosts >2012-08-06 03:20:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable hosts done >2012-08-06 03:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable storage domains >2012-08-06 03:20:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Autorecovering 0 storage domains >2012-08-06 03:20:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable storage domains done >2012-08-06 03:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable hosts >2012-08-06 03:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Autorecovering 0 hosts >2012-08-06 03:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable hosts done >2012-08-06 03:25:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable storage domains >2012-08-06 03:25:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Autorecovering 0 storage domains >2012-08-06 03:25:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable storage domains done >2012-08-06 03:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Checking autorecoverable hosts >2012-08-06 03:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Autorecovering 0 hosts >2012-08-06 03:30:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Checking autorecoverable hosts done >2012-08-06 03:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Checking autorecoverable storage domains >2012-08-06 03:30:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Autorecovering 0 storage domains >2012-08-06 03:30:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Checking autorecoverable storage domains done >2012-08-06 03:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Checking autorecoverable hosts >2012-08-06 03:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Autorecovering 0 hosts >2012-08-06 03:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Checking autorecoverable hosts done >2012-08-06 03:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Checking autorecoverable storage domains >2012-08-06 03:35:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Autorecovering 0 storage domains >2012-08-06 03:35:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Checking autorecoverable storage domains done >2012-08-06 03:35:35,013 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (QuartzScheduler_Worker-56) AuditLogCleanupManager::deleteAgedOutAuditLogs - entered >2012-08-06 03:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Checking autorecoverable hosts >2012-08-06 03:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Autorecovering 0 hosts >2012-08-06 03:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Checking autorecoverable hosts done >2012-08-06 03:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Checking autorecoverable storage domains >2012-08-06 03:40:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Autorecovering 0 storage domains >2012-08-06 03:40:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Checking autorecoverable storage domains done >2012-08-06 03:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Checking autorecoverable hosts >2012-08-06 03:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Autorecovering 0 hosts >2012-08-06 03:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Checking autorecoverable hosts done >2012-08-06 03:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Checking autorecoverable storage domains >2012-08-06 03:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Autorecovering 0 storage domains >2012-08-06 03:45:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Checking autorecoverable storage domains done >2012-08-06 03:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Checking autorecoverable hosts >2012-08-06 03:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Autorecovering 0 hosts >2012-08-06 03:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Checking autorecoverable hosts done >2012-08-06 03:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Checking autorecoverable storage domains >2012-08-06 03:50:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Autorecovering 0 storage domains >2012-08-06 03:50:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Checking autorecoverable storage domains done >2012-08-06 03:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable hosts >2012-08-06 03:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Autorecovering 0 hosts >2012-08-06 03:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable hosts done >2012-08-06 03:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable storage domains >2012-08-06 03:55:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Autorecovering 0 storage domains >2012-08-06 03:55:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable storage domains done >2012-08-06 04:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-70) Checking autorecoverable hosts >2012-08-06 04:00:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-70) Autorecovering 0 hosts >2012-08-06 04:00:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-70) Checking autorecoverable hosts done >2012-08-06 04:00:00,021 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-70) Checking autorecoverable storage domains >2012-08-06 04:00:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-70) Autorecovering 0 storage domains >2012-08-06 04:00:00,033 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-70) Checking autorecoverable storage domains done >2012-08-06 04:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable hosts >2012-08-06 04:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Autorecovering 0 hosts >2012-08-06 04:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable hosts done >2012-08-06 04:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable storage domains >2012-08-06 04:05:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Autorecovering 0 storage domains >2012-08-06 04:05:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable storage domains done >2012-08-06 04:09:55,926 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-91) DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 04:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) Checking autorecoverable hosts >2012-08-06 04:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) Autorecovering 0 hosts >2012-08-06 04:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) Checking autorecoverable hosts done >2012-08-06 04:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) Checking autorecoverable storage domains >2012-08-06 04:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) Autorecovering 0 storage domains >2012-08-06 04:10:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) Checking autorecoverable storage domains done >2012-08-06 04:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Checking autorecoverable hosts >2012-08-06 04:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Autorecovering 0 hosts >2012-08-06 04:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Checking autorecoverable hosts done >2012-08-06 04:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Checking autorecoverable storage domains >2012-08-06 04:15:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Autorecovering 0 storage domains >2012-08-06 04:15:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Checking autorecoverable storage domains done >2012-08-06 04:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable hosts >2012-08-06 04:20:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Autorecovering 0 hosts >2012-08-06 04:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable hosts done >2012-08-06 04:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable storage domains >2012-08-06 04:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Autorecovering 0 storage domains >2012-08-06 04:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable storage domains done >2012-08-06 04:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable hosts >2012-08-06 04:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Autorecovering 0 hosts >2012-08-06 04:25:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable hosts done >2012-08-06 04:25:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable storage domains >2012-08-06 04:25:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Autorecovering 0 storage domains >2012-08-06 04:25:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable storage domains done >2012-08-06 04:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) [133550ed] Checking autorecoverable hosts >2012-08-06 04:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) [133550ed] Autorecovering 0 hosts >2012-08-06 04:30:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) [133550ed] Checking autorecoverable hosts done >2012-08-06 04:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) [133550ed] Checking autorecoverable storage domains >2012-08-06 04:30:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) [133550ed] Autorecovering 0 storage domains >2012-08-06 04:30:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) [133550ed] Checking autorecoverable storage domains done >2012-08-06 04:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Checking autorecoverable hosts >2012-08-06 04:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Autorecovering 0 hosts >2012-08-06 04:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Checking autorecoverable hosts done >2012-08-06 04:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Checking autorecoverable storage domains >2012-08-06 04:35:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Autorecovering 0 storage domains >2012-08-06 04:35:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Checking autorecoverable storage domains done >2012-08-06 04:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable hosts >2012-08-06 04:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering 0 hosts >2012-08-06 04:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable hosts done >2012-08-06 04:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable storage domains >2012-08-06 04:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering 0 storage domains >2012-08-06 04:40:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable storage domains done >2012-08-06 04:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable hosts >2012-08-06 04:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Autorecovering 0 hosts >2012-08-06 04:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable hosts done >2012-08-06 04:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable storage domains >2012-08-06 04:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Autorecovering 0 storage domains >2012-08-06 04:45:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable storage domains done >2012-08-06 04:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Checking autorecoverable hosts >2012-08-06 04:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Autorecovering 0 hosts >2012-08-06 04:50:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Checking autorecoverable hosts done >2012-08-06 04:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Checking autorecoverable storage domains >2012-08-06 04:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Autorecovering 0 storage domains >2012-08-06 04:50:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Checking autorecoverable storage domains done >2012-08-06 04:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Checking autorecoverable hosts >2012-08-06 04:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Autorecovering 0 hosts >2012-08-06 04:55:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Checking autorecoverable hosts done >2012-08-06 04:55:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Checking autorecoverable storage domains >2012-08-06 04:55:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Autorecovering 0 storage domains >2012-08-06 04:55:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Checking autorecoverable storage domains done >2012-08-06 05:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable hosts >2012-08-06 05:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Autorecovering 0 hosts >2012-08-06 05:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable hosts done >2012-08-06 05:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable storage domains >2012-08-06 05:00:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Autorecovering 0 storage domains >2012-08-06 05:00:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable storage domains done >2012-08-06 05:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Checking autorecoverable hosts >2012-08-06 05:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Autorecovering 0 hosts >2012-08-06 05:05:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Checking autorecoverable hosts done >2012-08-06 05:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Checking autorecoverable storage domains >2012-08-06 05:05:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Autorecovering 0 storage domains >2012-08-06 05:05:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Checking autorecoverable storage domains done >2012-08-06 05:09:55,932 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-56) DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 05:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable hosts >2012-08-06 05:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Autorecovering 0 hosts >2012-08-06 05:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable hosts done >2012-08-06 05:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable storage domains >2012-08-06 05:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Autorecovering 0 storage domains >2012-08-06 05:10:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable storage domains done >2012-08-06 05:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable hosts >2012-08-06 05:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Autorecovering 0 hosts >2012-08-06 05:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable hosts done >2012-08-06 05:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable storage domains >2012-08-06 05:15:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Autorecovering 0 storage domains >2012-08-06 05:15:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable storage domains done >2012-08-06 05:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable hosts >2012-08-06 05:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Autorecovering 0 hosts >2012-08-06 05:20:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable hosts done >2012-08-06 05:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable storage domains >2012-08-06 05:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Autorecovering 0 storage domains >2012-08-06 05:20:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable storage domains done >2012-08-06 05:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts >2012-08-06 05:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering 0 hosts >2012-08-06 05:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts done >2012-08-06 05:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable storage domains >2012-08-06 05:25:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering 0 storage domains >2012-08-06 05:25:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable storage domains done >2012-08-06 05:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable hosts >2012-08-06 05:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Autorecovering 0 hosts >2012-08-06 05:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable hosts done >2012-08-06 05:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable storage domains >2012-08-06 05:30:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Autorecovering 0 storage domains >2012-08-06 05:30:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable storage domains done >2012-08-06 05:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Checking autorecoverable hosts >2012-08-06 05:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Autorecovering 0 hosts >2012-08-06 05:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Checking autorecoverable hosts done >2012-08-06 05:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Checking autorecoverable storage domains >2012-08-06 05:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Autorecovering 0 storage domains >2012-08-06 05:35:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Checking autorecoverable storage domains done >2012-08-06 05:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Checking autorecoverable hosts >2012-08-06 05:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Autorecovering 0 hosts >2012-08-06 05:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Checking autorecoverable hosts done >2012-08-06 05:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Checking autorecoverable storage domains >2012-08-06 05:40:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Autorecovering 0 storage domains >2012-08-06 05:40:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Checking autorecoverable storage domains done >2012-08-06 05:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable hosts >2012-08-06 05:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Autorecovering 0 hosts >2012-08-06 05:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable hosts done >2012-08-06 05:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable storage domains >2012-08-06 05:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Autorecovering 0 storage domains >2012-08-06 05:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable storage domains done >2012-08-06 05:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts >2012-08-06 05:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering 0 hosts >2012-08-06 05:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts done >2012-08-06 05:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable storage domains >2012-08-06 05:50:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering 0 storage domains >2012-08-06 05:50:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable storage domains done >2012-08-06 05:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable hosts >2012-08-06 05:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Autorecovering 0 hosts >2012-08-06 05:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable hosts done >2012-08-06 05:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable storage domains >2012-08-06 05:55:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Autorecovering 0 storage domains >2012-08-06 05:55:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable storage domains done >2012-08-06 06:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable hosts >2012-08-06 06:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Autorecovering 0 hosts >2012-08-06 06:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable hosts done >2012-08-06 06:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable storage domains >2012-08-06 06:00:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Autorecovering 0 storage domains >2012-08-06 06:00:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable storage domains done >2012-08-06 06:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable hosts >2012-08-06 06:05:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Autorecovering 0 hosts >2012-08-06 06:05:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable hosts done >2012-08-06 06:05:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable storage domains >2012-08-06 06:05:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Autorecovering 0 storage domains >2012-08-06 06:05:00,032 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable storage domains done >2012-08-06 06:09:55,937 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-97) DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 06:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable hosts >2012-08-06 06:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Autorecovering 0 hosts >2012-08-06 06:10:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable hosts done >2012-08-06 06:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable storage domains >2012-08-06 06:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Autorecovering 0 storage domains >2012-08-06 06:10:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable storage domains done >2012-08-06 06:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable hosts >2012-08-06 06:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Autorecovering 0 hosts >2012-08-06 06:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable hosts done >2012-08-06 06:15:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable storage domains >2012-08-06 06:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Autorecovering 0 storage domains >2012-08-06 06:15:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable storage domains done >2012-08-06 06:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Checking autorecoverable hosts >2012-08-06 06:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Autorecovering 0 hosts >2012-08-06 06:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Checking autorecoverable hosts done >2012-08-06 06:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Checking autorecoverable storage domains >2012-08-06 06:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Autorecovering 0 storage domains >2012-08-06 06:20:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Checking autorecoverable storage domains done >2012-08-06 06:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) Checking autorecoverable hosts >2012-08-06 06:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) Autorecovering 0 hosts >2012-08-06 06:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) Checking autorecoverable hosts done >2012-08-06 06:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) Checking autorecoverable storage domains >2012-08-06 06:25:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) Autorecovering 0 storage domains >2012-08-06 06:25:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) Checking autorecoverable storage domains done >2012-08-06 06:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable hosts >2012-08-06 06:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Autorecovering 0 hosts >2012-08-06 06:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable hosts done >2012-08-06 06:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable storage domains >2012-08-06 06:30:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Autorecovering 0 storage domains >2012-08-06 06:30:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable storage domains done >2012-08-06 06:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable hosts >2012-08-06 06:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Autorecovering 0 hosts >2012-08-06 06:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable hosts done >2012-08-06 06:35:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable storage domains >2012-08-06 06:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Autorecovering 0 storage domains >2012-08-06 06:35:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable storage domains done >2012-08-06 06:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Checking autorecoverable hosts >2012-08-06 06:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Autorecovering 0 hosts >2012-08-06 06:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Checking autorecoverable hosts done >2012-08-06 06:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Checking autorecoverable storage domains >2012-08-06 06:40:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Autorecovering 0 storage domains >2012-08-06 06:40:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Checking autorecoverable storage domains done >2012-08-06 06:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Checking autorecoverable hosts >2012-08-06 06:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Autorecovering 0 hosts >2012-08-06 06:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Checking autorecoverable hosts done >2012-08-06 06:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Checking autorecoverable storage domains >2012-08-06 06:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Autorecovering 0 storage domains >2012-08-06 06:45:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Checking autorecoverable storage domains done >2012-08-06 06:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable hosts >2012-08-06 06:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Autorecovering 0 hosts >2012-08-06 06:50:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable hosts done >2012-08-06 06:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable storage domains >2012-08-06 06:50:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Autorecovering 0 storage domains >2012-08-06 06:50:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable storage domains done >2012-08-06 06:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Checking autorecoverable hosts >2012-08-06 06:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Autorecovering 0 hosts >2012-08-06 06:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Checking autorecoverable hosts done >2012-08-06 06:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Checking autorecoverable storage domains >2012-08-06 06:55:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Autorecovering 0 storage domains >2012-08-06 06:55:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Checking autorecoverable storage domains done >2012-08-06 07:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) Checking autorecoverable hosts >2012-08-06 07:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) Autorecovering 0 hosts >2012-08-06 07:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) Checking autorecoverable hosts done >2012-08-06 07:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) Checking autorecoverable storage domains >2012-08-06 07:00:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) Autorecovering 0 storage domains >2012-08-06 07:00:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) Checking autorecoverable storage domains done >2012-08-06 07:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable hosts >2012-08-06 07:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Autorecovering 0 hosts >2012-08-06 07:05:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable hosts done >2012-08-06 07:05:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable storage domains >2012-08-06 07:05:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Autorecovering 0 storage domains >2012-08-06 07:05:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable storage domains done >2012-08-06 07:09:55,939 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-58) DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 07:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable hosts >2012-08-06 07:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Autorecovering 0 hosts >2012-08-06 07:10:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable hosts done >2012-08-06 07:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable storage domains >2012-08-06 07:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Autorecovering 0 storage domains >2012-08-06 07:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable storage domains done >2012-08-06 07:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable hosts >2012-08-06 07:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Autorecovering 0 hosts >2012-08-06 07:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable hosts done >2012-08-06 07:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable storage domains >2012-08-06 07:15:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Autorecovering 0 storage domains >2012-08-06 07:15:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable storage domains done >2012-08-06 07:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-53) Checking autorecoverable hosts >2012-08-06 07:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-53) Autorecovering 0 hosts >2012-08-06 07:20:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-53) Checking autorecoverable hosts done >2012-08-06 07:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-53) Checking autorecoverable storage domains >2012-08-06 07:20:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-53) Autorecovering 0 storage domains >2012-08-06 07:20:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-53) Checking autorecoverable storage domains done >2012-08-06 07:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) Checking autorecoverable hosts >2012-08-06 07:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) Autorecovering 0 hosts >2012-08-06 07:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) Checking autorecoverable hosts done >2012-08-06 07:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) Checking autorecoverable storage domains >2012-08-06 07:25:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) Autorecovering 0 storage domains >2012-08-06 07:25:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) Checking autorecoverable storage domains done >2012-08-06 07:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable hosts >2012-08-06 07:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Autorecovering 0 hosts >2012-08-06 07:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable hosts done >2012-08-06 07:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable storage domains >2012-08-06 07:30:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Autorecovering 0 storage domains >2012-08-06 07:30:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable storage domains done >2012-08-06 07:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Checking autorecoverable hosts >2012-08-06 07:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Autorecovering 0 hosts >2012-08-06 07:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Checking autorecoverable hosts done >2012-08-06 07:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Checking autorecoverable storage domains >2012-08-06 07:35:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Autorecovering 0 storage domains >2012-08-06 07:35:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Checking autorecoverable storage domains done >2012-08-06 07:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable hosts >2012-08-06 07:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Autorecovering 0 hosts >2012-08-06 07:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable hosts done >2012-08-06 07:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable storage domains >2012-08-06 07:40:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Autorecovering 0 storage domains >2012-08-06 07:40:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable storage domains done >2012-08-06 07:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Checking autorecoverable hosts >2012-08-06 07:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Autorecovering 0 hosts >2012-08-06 07:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Checking autorecoverable hosts done >2012-08-06 07:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Checking autorecoverable storage domains >2012-08-06 07:45:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Autorecovering 0 storage domains >2012-08-06 07:45:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Checking autorecoverable storage domains done >2012-08-06 07:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable hosts >2012-08-06 07:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Autorecovering 0 hosts >2012-08-06 07:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable hosts done >2012-08-06 07:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable storage domains >2012-08-06 07:50:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Autorecovering 0 storage domains >2012-08-06 07:50:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable storage domains done >2012-08-06 07:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) Checking autorecoverable hosts >2012-08-06 07:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) Autorecovering 0 hosts >2012-08-06 07:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) Checking autorecoverable hosts done >2012-08-06 07:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) Checking autorecoverable storage domains >2012-08-06 07:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) Autorecovering 0 storage domains >2012-08-06 07:55:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) Checking autorecoverable storage domains done >2012-08-06 08:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable hosts >2012-08-06 08:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Autorecovering 0 hosts >2012-08-06 08:00:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable hosts done >2012-08-06 08:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable storage domains >2012-08-06 08:00:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Autorecovering 0 storage domains >2012-08-06 08:00:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable storage domains done >2012-08-06 08:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Checking autorecoverable hosts >2012-08-06 08:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Autorecovering 0 hosts >2012-08-06 08:05:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Checking autorecoverable hosts done >2012-08-06 08:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Checking autorecoverable storage domains >2012-08-06 08:05:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Autorecovering 0 storage domains >2012-08-06 08:05:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Checking autorecoverable storage domains done >2012-08-06 08:09:55,941 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-4) DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 08:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Checking autorecoverable hosts >2012-08-06 08:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Autorecovering 0 hosts >2012-08-06 08:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Checking autorecoverable hosts done >2012-08-06 08:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Checking autorecoverable storage domains >2012-08-06 08:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Autorecovering 0 storage domains >2012-08-06 08:10:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Checking autorecoverable storage domains done >2012-08-06 08:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable hosts >2012-08-06 08:15:00,021 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Autorecovering 0 hosts >2012-08-06 08:15:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable hosts done >2012-08-06 08:15:00,025 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable storage domains >2012-08-06 08:15:00,029 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Autorecovering 0 storage domains >2012-08-06 08:15:00,031 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable storage domains done >2012-08-06 08:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Checking autorecoverable hosts >2012-08-06 08:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Autorecovering 0 hosts >2012-08-06 08:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Checking autorecoverable hosts done >2012-08-06 08:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Checking autorecoverable storage domains >2012-08-06 08:20:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Autorecovering 0 storage domains >2012-08-06 08:20:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Checking autorecoverable storage domains done >2012-08-06 08:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Checking autorecoverable hosts >2012-08-06 08:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Autorecovering 0 hosts >2012-08-06 08:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Checking autorecoverable hosts done >2012-08-06 08:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Checking autorecoverable storage domains >2012-08-06 08:25:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Autorecovering 0 storage domains >2012-08-06 08:25:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Checking autorecoverable storage domains done >2012-08-06 08:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Checking autorecoverable hosts >2012-08-06 08:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Autorecovering 0 hosts >2012-08-06 08:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Checking autorecoverable hosts done >2012-08-06 08:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Checking autorecoverable storage domains >2012-08-06 08:30:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Autorecovering 0 storage domains >2012-08-06 08:30:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Checking autorecoverable storage domains done >2012-08-06 08:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Checking autorecoverable hosts >2012-08-06 08:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Autorecovering 0 hosts >2012-08-06 08:35:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Checking autorecoverable hosts done >2012-08-06 08:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Checking autorecoverable storage domains >2012-08-06 08:35:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Autorecovering 0 storage domains >2012-08-06 08:35:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Checking autorecoverable storage domains done >2012-08-06 08:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) Checking autorecoverable hosts >2012-08-06 08:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) Autorecovering 0 hosts >2012-08-06 08:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) Checking autorecoverable hosts done >2012-08-06 08:40:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) Checking autorecoverable storage domains >2012-08-06 08:40:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) Autorecovering 0 storage domains >2012-08-06 08:40:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) Checking autorecoverable storage domains done >2012-08-06 08:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable hosts >2012-08-06 08:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Autorecovering 0 hosts >2012-08-06 08:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable hosts done >2012-08-06 08:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable storage domains >2012-08-06 08:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Autorecovering 0 storage domains >2012-08-06 08:45:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable storage domains done >2012-08-06 08:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable hosts >2012-08-06 08:50:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Autorecovering 0 hosts >2012-08-06 08:50:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable hosts done >2012-08-06 08:50:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable storage domains >2012-08-06 08:50:00,021 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Autorecovering 0 storage domains >2012-08-06 08:50:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable storage domains done >2012-08-06 08:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts >2012-08-06 08:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering 0 hosts >2012-08-06 08:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts done >2012-08-06 08:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable storage domains >2012-08-06 08:55:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering 0 storage domains >2012-08-06 08:55:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable storage domains done >2012-08-06 09:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) Checking autorecoverable hosts >2012-08-06 09:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) Autorecovering 0 hosts >2012-08-06 09:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) Checking autorecoverable hosts done >2012-08-06 09:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) Checking autorecoverable storage domains >2012-08-06 09:00:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) Autorecovering 0 storage domains >2012-08-06 09:00:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) Checking autorecoverable storage domains done >2012-08-06 09:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Checking autorecoverable hosts >2012-08-06 09:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Autorecovering 0 hosts >2012-08-06 09:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Checking autorecoverable hosts done >2012-08-06 09:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Checking autorecoverable storage domains >2012-08-06 09:05:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Autorecovering 0 storage domains >2012-08-06 09:05:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Checking autorecoverable storage domains done >2012-08-06 09:09:55,944 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-51) DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 09:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Checking autorecoverable hosts >2012-08-06 09:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Autorecovering 0 hosts >2012-08-06 09:10:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Checking autorecoverable hosts done >2012-08-06 09:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Checking autorecoverable storage domains >2012-08-06 09:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Autorecovering 0 storage domains >2012-08-06 09:10:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [5253de14] Checking autorecoverable storage domains done >2012-08-06 09:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable hosts >2012-08-06 09:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Autorecovering 0 hosts >2012-08-06 09:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable hosts done >2012-08-06 09:15:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable storage domains >2012-08-06 09:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Autorecovering 0 storage domains >2012-08-06 09:15:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable storage domains done >2012-08-06 09:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) Checking autorecoverable hosts >2012-08-06 09:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) Autorecovering 0 hosts >2012-08-06 09:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) Checking autorecoverable hosts done >2012-08-06 09:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) Checking autorecoverable storage domains >2012-08-06 09:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) Autorecovering 0 storage domains >2012-08-06 09:20:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) Checking autorecoverable storage domains done >2012-08-06 09:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) Checking autorecoverable hosts >2012-08-06 09:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) Autorecovering 0 hosts >2012-08-06 09:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) Checking autorecoverable hosts done >2012-08-06 09:25:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) Checking autorecoverable storage domains >2012-08-06 09:25:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) Autorecovering 0 storage domains >2012-08-06 09:25:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) Checking autorecoverable storage domains done >2012-08-06 09:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable hosts >2012-08-06 09:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Autorecovering 0 hosts >2012-08-06 09:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable hosts done >2012-08-06 09:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable storage domains >2012-08-06 09:30:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Autorecovering 0 storage domains >2012-08-06 09:30:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable storage domains done >2012-08-06 09:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable hosts >2012-08-06 09:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering 0 hosts >2012-08-06 09:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable hosts done >2012-08-06 09:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable storage domains >2012-08-06 09:35:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering 0 storage domains >2012-08-06 09:35:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable storage domains done >2012-08-06 09:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Checking autorecoverable hosts >2012-08-06 09:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Autorecovering 0 hosts >2012-08-06 09:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Checking autorecoverable hosts done >2012-08-06 09:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Checking autorecoverable storage domains >2012-08-06 09:40:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Autorecovering 0 storage domains >2012-08-06 09:40:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Checking autorecoverable storage domains done >2012-08-06 09:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Checking autorecoverable hosts >2012-08-06 09:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Autorecovering 0 hosts >2012-08-06 09:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Checking autorecoverable hosts done >2012-08-06 09:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Checking autorecoverable storage domains >2012-08-06 09:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Autorecovering 0 storage domains >2012-08-06 09:45:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Checking autorecoverable storage domains done >2012-08-06 09:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Checking autorecoverable hosts >2012-08-06 09:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Autorecovering 0 hosts >2012-08-06 09:50:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Checking autorecoverable hosts done >2012-08-06 09:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Checking autorecoverable storage domains >2012-08-06 09:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Autorecovering 0 storage domains >2012-08-06 09:50:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Checking autorecoverable storage domains done >2012-08-06 09:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) Checking autorecoverable hosts >2012-08-06 09:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) Autorecovering 0 hosts >2012-08-06 09:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) Checking autorecoverable hosts done >2012-08-06 09:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) Checking autorecoverable storage domains >2012-08-06 09:55:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) Autorecovering 0 storage domains >2012-08-06 09:55:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) Checking autorecoverable storage domains done >2012-08-06 10:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable hosts >2012-08-06 10:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Autorecovering 0 hosts >2012-08-06 10:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable hosts done >2012-08-06 10:00:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable storage domains >2012-08-06 10:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Autorecovering 0 storage domains >2012-08-06 10:00:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable storage domains done >2012-08-06 10:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Checking autorecoverable hosts >2012-08-06 10:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Autorecovering 0 hosts >2012-08-06 10:05:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Checking autorecoverable hosts done >2012-08-06 10:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Checking autorecoverable storage domains >2012-08-06 10:05:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Autorecovering 0 storage domains >2012-08-06 10:05:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Checking autorecoverable storage domains done >2012-08-06 10:09:55,947 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-25) DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 10:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Checking autorecoverable hosts >2012-08-06 10:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Autorecovering 0 hosts >2012-08-06 10:10:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Checking autorecoverable hosts done >2012-08-06 10:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Checking autorecoverable storage domains >2012-08-06 10:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Autorecovering 0 storage domains >2012-08-06 10:10:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Checking autorecoverable storage domains done >2012-08-06 10:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) Checking autorecoverable hosts >2012-08-06 10:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) Autorecovering 0 hosts >2012-08-06 10:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) Checking autorecoverable hosts done >2012-08-06 10:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) Checking autorecoverable storage domains >2012-08-06 10:15:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) Autorecovering 0 storage domains >2012-08-06 10:15:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) Checking autorecoverable storage domains done >2012-08-06 10:20:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Checking autorecoverable hosts >2012-08-06 10:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Autorecovering 0 hosts >2012-08-06 10:20:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Checking autorecoverable hosts done >2012-08-06 10:20:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Checking autorecoverable storage domains >2012-08-06 10:20:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Autorecovering 0 storage domains >2012-08-06 10:20:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Checking autorecoverable storage domains done >2012-08-06 10:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable hosts >2012-08-06 10:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Autorecovering 0 hosts >2012-08-06 10:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable hosts done >2012-08-06 10:25:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable storage domains >2012-08-06 10:25:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Autorecovering 0 storage domains >2012-08-06 10:25:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable storage domains done >2012-08-06 10:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts >2012-08-06 10:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering 0 hosts >2012-08-06 10:30:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts done >2012-08-06 10:30:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable storage domains >2012-08-06 10:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering 0 storage domains >2012-08-06 10:30:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable storage domains done >2012-08-06 10:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Checking autorecoverable hosts >2012-08-06 10:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Autorecovering 0 hosts >2012-08-06 10:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Checking autorecoverable hosts done >2012-08-06 10:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Checking autorecoverable storage domains >2012-08-06 10:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Autorecovering 0 storage domains >2012-08-06 10:35:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Checking autorecoverable storage domains done >2012-08-06 10:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable hosts >2012-08-06 10:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Autorecovering 0 hosts >2012-08-06 10:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable hosts done >2012-08-06 10:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable storage domains >2012-08-06 10:40:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Autorecovering 0 storage domains >2012-08-06 10:40:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable storage domains done >2012-08-06 10:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable hosts >2012-08-06 10:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering 0 hosts >2012-08-06 10:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable hosts done >2012-08-06 10:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable storage domains >2012-08-06 10:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering 0 storage domains >2012-08-06 10:45:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable storage domains done >2012-08-06 10:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) Checking autorecoverable hosts >2012-08-06 10:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) Autorecovering 0 hosts >2012-08-06 10:50:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) Checking autorecoverable hosts done >2012-08-06 10:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) Checking autorecoverable storage domains >2012-08-06 10:50:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) Autorecovering 0 storage domains >2012-08-06 10:50:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) Checking autorecoverable storage domains done >2012-08-06 10:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) Checking autorecoverable hosts >2012-08-06 10:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) Autorecovering 0 hosts >2012-08-06 10:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) Checking autorecoverable hosts done >2012-08-06 10:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) Checking autorecoverable storage domains >2012-08-06 10:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) Autorecovering 0 storage domains >2012-08-06 10:55:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) Checking autorecoverable storage domains done >2012-08-06 10:59:59,999 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) Checking autorecoverable hosts >2012-08-06 11:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) Autorecovering 0 hosts >2012-08-06 11:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) Checking autorecoverable hosts done >2012-08-06 11:00:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) Checking autorecoverable storage domains >2012-08-06 11:00:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) Autorecovering 0 storage domains >2012-08-06 11:00:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) Checking autorecoverable storage domains done >2012-08-06 11:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable hosts >2012-08-06 11:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Autorecovering 0 hosts >2012-08-06 11:05:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable hosts done >2012-08-06 11:05:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable storage domains >2012-08-06 11:05:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Autorecovering 0 storage domains >2012-08-06 11:05:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable storage domains done >2012-08-06 11:09:55,950 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-32) DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 11:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Checking autorecoverable hosts >2012-08-06 11:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Autorecovering 0 hosts >2012-08-06 11:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Checking autorecoverable hosts done >2012-08-06 11:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Checking autorecoverable storage domains >2012-08-06 11:10:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Autorecovering 0 storage domains >2012-08-06 11:10:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Checking autorecoverable storage domains done >2012-08-06 11:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) Checking autorecoverable hosts >2012-08-06 11:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) Autorecovering 0 hosts >2012-08-06 11:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) Checking autorecoverable hosts done >2012-08-06 11:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) Checking autorecoverable storage domains >2012-08-06 11:15:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) Autorecovering 0 storage domains >2012-08-06 11:15:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) Checking autorecoverable storage domains done >2012-08-06 11:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable hosts >2012-08-06 11:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Autorecovering 0 hosts >2012-08-06 11:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable hosts done >2012-08-06 11:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable storage domains >2012-08-06 11:20:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Autorecovering 0 storage domains >2012-08-06 11:20:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable storage domains done >2012-08-06 11:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Checking autorecoverable hosts >2012-08-06 11:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Autorecovering 0 hosts >2012-08-06 11:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Checking autorecoverable hosts done >2012-08-06 11:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Checking autorecoverable storage domains >2012-08-06 11:25:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Autorecovering 0 storage domains >2012-08-06 11:25:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Checking autorecoverable storage domains done >2012-08-06 11:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts >2012-08-06 11:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering 0 hosts >2012-08-06 11:30:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts done >2012-08-06 11:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable storage domains >2012-08-06 11:30:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering 0 storage domains >2012-08-06 11:30:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable storage domains done >2012-08-06 11:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts >2012-08-06 11:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering 0 hosts >2012-08-06 11:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts done >2012-08-06 11:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable storage domains >2012-08-06 11:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering 0 storage domains >2012-08-06 11:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable storage domains done >2012-08-06 11:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable hosts >2012-08-06 11:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Autorecovering 0 hosts >2012-08-06 11:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable hosts done >2012-08-06 11:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable storage domains >2012-08-06 11:40:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Autorecovering 0 storage domains >2012-08-06 11:40:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable storage domains done >2012-08-06 11:43:50,940 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-5) Checking if user admin@internal is an admin, result true >2012-08-06 11:43:50,941 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-5) Running command: LoginAdminUserCommand internal: false. >2012-08-06 11:44:31,670 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-11) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 4e67a756 >2012-08-06 11:44:32,598 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-11) FINISH, GetDeviceListVDSCommand, return: [], log id: 4e67a756 >2012-08-06 11:44:42,454 INFO [org.ovirt.engine.core.bll.MaintananceNumberOfVdssCommand] (pool-3-thread-49) [53b5d616] Running command: MaintananceNumberOfVdssCommand internal: false. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 11:44:42,457 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-49) [53b5d616] START, SetVdsStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, status=PreparingForMaintenance, nonOperationalReason=NONE), log id: 311646f5 >2012-08-06 11:44:42,564 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-49) [53b5d616] FINISH, SetVdsStatusVDSCommand, log id: 311646f5 >2012-08-06 11:44:42,676 INFO [org.ovirt.engine.core.bll.MaintananceVdsCommand] (pool-3-thread-49) [32882557] Running command: MaintananceVdsCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 11:44:42,729 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-35) vds::Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 4196a566-dee6-11e1-b66e-c35c5273fee7 : purple-vds2 >2012-08-06 11:44:42,790 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-35) Clearing cache of pool: 66f96b6e-dee5-11e1-a6fd-f39cbdf23023 for problematic entities of VDS: purple-vds2. >2012-08-06 11:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable hosts >2012-08-06 11:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Autorecovering 0 hosts >2012-08-06 11:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable hosts done >2012-08-06 11:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable storage domains >2012-08-06 11:45:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Autorecovering 0 storage domains >2012-08-06 11:45:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable storage domains done >2012-08-06 11:45:03,897 INFO [org.ovirt.engine.core.bll.AddVdsGroupCommand] (ajp--127.0.0.1-8009-10) [746f1a4d] Running command: AddVdsGroupCommand internal: false. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-06 11:45:11,447 INFO [org.ovirt.engine.core.bll.ChangeVDSClusterCommand] (ajp--127.0.0.1-8009-3) [332e15be] Running command: ChangeVDSClusterCommand internal: false. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS, ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups >2012-08-06 11:45:11,534 INFO [org.ovirt.engine.core.bll.RemoveVdsSpmIdCommand] (ajp--127.0.0.1-8009-3) [332e15be] Running command: RemoveVdsSpmIdCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 11:45:11,588 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp--127.0.0.1-8009-3) [332e15be] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 11:45:11,678 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp--127.0.0.1-8009-3) [332e15be] Lock freed to object EngineLock [exclusiveLocks= key: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f value: REGISTER_VDS >, sharedLocks= ] >2012-08-06 11:45:11,767 INFO [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp--127.0.0.1-8009-6) [1b9304b1] Running command: UpdateVdsCommand internal: false. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 11:45:12,719 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp--127.0.0.1-8009-10) Lock Acquired to object EngineLock [exclusiveLocks= key: 4196a566-dee6-11e1-b66e-c35c5273fee7 value: VDS >, sharedLocks= ] >2012-08-06 11:45:12,782 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-3-thread-48) [bbcb998] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 11:45:12,818 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-48) [bbcb998] START, SetVdsStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, status=Unassigned, nonOperationalReason=NONE), log id: 7b0a8078 >2012-08-06 11:45:12,826 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-48) [bbcb998] FINISH, SetVdsStatusVDSCommand, log id: 7b0a8078 >2012-08-06 11:45:12,873 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (pool-3-thread-48) [bbcb998] START, ActivateVdsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7), log id: 60b10562 >2012-08-06 11:45:13,304 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (pool-3-thread-48) [7323f041] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 11:45:13,311 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (pool-3-thread-48) [76bb5401] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 11:45:13,320 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (pool-3-thread-48) [76bb5401] FINISH, ActivateVdsVDSCommand, log id: 60b10562 >2012-08-06 11:45:13,359 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-3-thread-48) [76bb5401] Lock freed to object EngineLock [exclusiveLocks= key: 4196a566-dee6-11e1-b66e-c35c5273fee7 value: VDS >, sharedLocks= ] >2012-08-06 11:45:15,209 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-84) [76e5d841] Running command: InitVdsOnUpCommand internal: true. >2012-08-06 11:45:15,220 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-84) [76e5d841] No string for UNASSIGNED type. Use default Log >2012-08-06 11:45:15,224 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) [76e5d841] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-08-06 11:45:15,249 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-84) [649a3b68] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 11:45:15,265 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-84) [6ac286bc] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 11:45:17,900 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-9) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 7f9497de >2012-08-06 11:45:18,843 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-9) FINISH, GetDeviceListVDSCommand, return: [], log id: 7f9497de >2012-08-06 11:45:43,807 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-7) [4b2e39d7] START, ValidateStorageServerConnectionVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: f6121783-5d14-493d-a12e-9b31402f985b, connection: orion.qa.lab.tlv.redhat.com:/export/lesik };]), log id: 2a091c60 >2012-08-06 11:45:43,836 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-7) [4b2e39d7] FINISH, ValidateStorageServerConnectionVDSCommand, return: {f6121783-5d14-493d-a12e-9b31402f985b=0}, log id: 2a091c60 >2012-08-06 11:45:43,875 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8009-7) [4b2e39d7] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-06 11:45:43,881 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-7) [4b2e39d7] START, ConnectStorageServerVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: f6121783-5d14-493d-a12e-9b31402f985b, connection: orion.qa.lab.tlv.redhat.com:/export/lesik };]), log id: 2423fb76 >2012-08-06 11:45:44,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-7) [4b2e39d7] FINISH, ConnectStorageServerVDSCommand, return: {f6121783-5d14-493d-a12e-9b31402f985b=0}, log id: 2423fb76 >2012-08-06 11:45:44,283 INFO [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp--127.0.0.1-8009-1) [58291d00] Running command: AddNFSStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-06 11:45:44,324 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8009-1) [58291d00] START, CreateStorageDomainVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storageDomain=org.ovirt.engine.core.common.businessentities.storage_domain_static@42c31cff, args=orion.qa.lab.tlv.redhat.com:/export/lesik), log id: 2c225328 >2012-08-06 11:45:47,145 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8009-1) [58291d00] FINISH, CreateStorageDomainVDSCommand, log id: 2c225328 >2012-08-06 11:45:47,148 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp--127.0.0.1-8009-1) [58291d00] START, GetStorageDomainStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storageDomainId=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a), log id: 51de4d05 >2012-08-06 11:45:47,179 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp--127.0.0.1-8009-1) [58291d00] FINISH, GetStorageDomainStatsVDSCommand, return: org.ovirt.engine.core.common.businessentities.storage_domains@749830cf, log id: 51de4d05 >2012-08-06 11:45:47,453 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageServerConnectionCommand] (ajp--127.0.0.1-8009-2) [540c82a8] Running command: RemoveStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-06 11:45:47,457 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-2) [540c82a8] START, DisconnectStorageServerVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: orion.qa.lab.tlv.redhat.com:/export/lesik };]), log id: 7342aa3f >2012-08-06 11:45:49,605 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-2) [540c82a8] FINISH, DisconnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 7342aa3f >2012-08-06 11:45:50,222 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8009-11) [7e9a520b] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 11:45:50,237 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp--127.0.0.1-8009-11) [6f46e43c] Lock Acquired to object EngineLock [exclusiveLocks= key: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f value: POOL >, sharedLocks= ] >2012-08-06 11:45:50,253 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp--127.0.0.1-8009-11) [6f46e43c] Running command: AddStoragePoolWithStoragesCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-06 11:45:50,447 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-11) [5e2861e3] START, ValidateStorageServerConnectionVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: f6121783-5d14-493d-a12e-9b31402f985b, connection: orion.qa.lab.tlv.redhat.com:/export/lesik };]), log id: 62b6fb71 >2012-08-06 11:45:50,473 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-11) [5e2861e3] FINISH, ValidateStorageServerConnectionVDSCommand, return: {f6121783-5d14-493d-a12e-9b31402f985b=0}, log id: 62b6fb71 >2012-08-06 11:45:50,474 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-11) [5e2861e3] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-06 11:45:50,479 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-11) [5e2861e3] START, ConnectStorageServerVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: f6121783-5d14-493d-a12e-9b31402f985b, connection: orion.qa.lab.tlv.redhat.com:/export/lesik };]), log id: 5db6b270 >2012-08-06 11:45:50,548 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-11) [5e2861e3] FINISH, ConnectStorageServerVDSCommand, return: {f6121783-5d14-493d-a12e-9b31402f985b=0}, log id: 5db6b270 >2012-08-06 11:45:50,551 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (ajp--127.0.0.1-8009-11) [5e2861e3] START, CreateStoragePoolVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, storageType=NFS, storagePoolName=nfs31, masterDomainId=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, domainsIdList=[a9af3dac-1730-4ec8-8d7f-0507cee4aa1a], masterVersion=1), log id: 20a3ab21 >2012-08-06 11:45:54,081 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-5) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 41a22a1d >2012-08-06 11:45:54,879 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-5) FINISH, GetDeviceListVDSCommand, return: [], log id: 41a22a1d >2012-08-06 11:46:16,634 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (ajp--127.0.0.1-8009-11) [5e2861e3] FINISH, CreateStoragePoolVDSCommand, log id: 20a3ab21 >2012-08-06 11:46:16,678 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp--127.0.0.1-8009-11) [5e2861e3] Lock freed to object EngineLock [exclusiveLocks= key: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f value: POOL >, sharedLocks= ] >2012-08-06 11:46:16,685 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8009-11) [5c47dc9c] Lock Acquired to object EngineLock [exclusiveLocks= key: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a value: STORAGE >, sharedLocks= ] >2012-08-06 11:46:16,729 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8009-11) [5c47dc9c] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 11:46:16,763 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8009-11) [5c47dc9c] Lock freed to object EngineLock [exclusiveLocks= key: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a value: STORAGE >, sharedLocks= ] >2012-08-06 11:46:16,768 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8009-11) [5c47dc9c] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 11:46 AM >2012-08-06 11:46:16,789 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (pool-3-thread-48) [64415e37] START, ValidateStorageServerConnectionVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: f6121783-5d14-493d-a12e-9b31402f985b, connection: orion.qa.lab.tlv.redhat.com:/export/lesik };]), log id: 1ced517a >2012-08-06 11:46:16,819 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (pool-3-thread-48) [64415e37] FINISH, ValidateStorageServerConnectionVDSCommand, return: {f6121783-5d14-493d-a12e-9b31402f985b=0}, log id: 1ced517a >2012-08-06 11:46:16,820 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-3-thread-48) [64415e37] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-06 11:46:16,826 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [64415e37] START, ConnectStorageServerVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: f6121783-5d14-493d-a12e-9b31402f985b, connection: orion.qa.lab.tlv.redhat.com:/export/lesik };]), log id: 7d19569f >2012-08-06 11:46:16,859 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [64415e37] FINISH, ConnectStorageServerVDSCommand, return: {f6121783-5d14-493d-a12e-9b31402f985b=0}, log id: 7d19569f >2012-08-06 11:46:16,861 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8009-11) [5c47dc9c] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 11:46 AM >2012-08-06 11:46:16,870 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp--127.0.0.1-8009-11) [5c47dc9c] START, ActivateStorageDomainVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a), log id: 5292685c >2012-08-06 11:46:16,898 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (ajp--127.0.0.1-8009-11) [4c794059] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-06 11:46:16,985 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (ajp--127.0.0.1-8009-11) [4c794059] hostFromVds::selectedVds - purple-vds2, spmStatus Unknown_Pool, storage pool nfs31 >2012-08-06 11:46:17,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (ajp--127.0.0.1-8009-11) [4c794059] START, ConnectStoragePoolVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, vds_spm_id = 1, masterDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, masterVersion = 1), log id: 37db922 >2012-08-06 11:46:19,243 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (ajp--127.0.0.1-8009-11) [4c794059] FINISH, ConnectStoragePoolVDSCommand, log id: 37db922 >2012-08-06 11:46:19,285 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (ajp--127.0.0.1-8009-11) [4c794059] hostFromVds::Connected host to pool - selectedVds - purple-vds2, spmStatus Free, storage pool nfs31 >2012-08-06 11:46:19,309 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (ajp--127.0.0.1-8009-11) [4c794059] starting spm on vds purple-vds2, storage pool nfs31, prevId -1, LVER -1 >2012-08-06 11:46:19,317 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp--127.0.0.1-8009-11) [4c794059] START, SpmStartVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 70560cc0 >2012-08-06 11:46:19,358 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp--127.0.0.1-8009-11) [4c794059] spmStart polling started: taskId = b079a9d6-2480-40de-8f85-960aeec515d7 >2012-08-06 11:46:40,865 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp--127.0.0.1-8009-11) [4c794059] spmStart polling ended: taskId = b079a9d6-2480-40de-8f85-960aeec515d7 task status = finished >2012-08-06 11:46:40,885 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp--127.0.0.1-8009-11) [4c794059] spmStart polling ended. spm status: SPM >2012-08-06 11:46:40,889 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (ajp--127.0.0.1-8009-11) [4c794059] START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=b079a9d6-2480-40de-8f85-960aeec515d7), log id: 5c0dc53e >2012-08-06 11:46:40,914 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (ajp--127.0.0.1-8009-11) [4c794059] FINISH, HSMClearTaskVDSCommand, log id: 5c0dc53e >2012-08-06 11:46:40,914 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp--127.0.0.1-8009-11) [4c794059] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@4d12457b, log id: 70560cc0 >2012-08-06 11:46:40,930 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (ajp--127.0.0.1-8009-11) [4c794059] Initialize Irs proxy from vds: purple-vds2 >2012-08-06 11:46:41,030 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp--127.0.0.1-8009-11) [4c794059] FINISH, ActivateStorageDomainVDSCommand, log id: 5292685c >2012-08-06 11:46:41,031 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8009-11) [4c794059] ActivateStorage Domain. After Activate storage domain in vds. Time:8/6/12 11:46 AM >2012-08-06 11:46:41,119 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-3-thread-50) [4c794059] START, ConnectStoragePoolVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, vds_spm_id = 1, masterDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, masterVersion = 1), log id: 305b9ec2 >2012-08-06 11:46:41,150 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-3-thread-50) [4c794059] FINISH, ConnectStoragePoolVDSCommand, log id: 305b9ec2 >2012-08-06 11:46:41,151 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8009-11) [4c794059] ActivateStorage Domain. After Refresh all pools . Time:8/6/12 11:46 AM >2012-08-06 11:46:41,228 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8009-11) [4c794059] ActivateStorage Domain. After change storage pool status in vds. Time:8/6/12 11:46 AM >2012-08-06 11:46:54,647 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8009-2) [12fc1f87] Lock Acquired to object EngineLock [exclusiveLocks= key: new value: VM_NAME >, sharedLocks= ] >2012-08-06 11:46:54,713 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-2) [12fc1f87] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 557c0f91 >2012-08-06 11:46:54,719 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-2) [12fc1f87] FINISH, IsValidVDSCommand, return: true, log id: 557c0f91 >2012-08-06 11:46:54,883 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8009-2) [12fc1f87] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups >2012-08-06 11:46:54,887 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-2) [12fc1f87] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6ee7b9fc >2012-08-06 11:46:54,892 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-2) [12fc1f87] FINISH, IsValidVDSCommand, return: true, log id: 6ee7b9fc >2012-08-06 11:46:55,055 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8009-2) [12fc1f87] Lock freed to object EngineLock [exclusiveLocks= key: new value: VM_NAME >, sharedLocks= ] >2012-08-06 11:46:59,959 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp--127.0.0.1-8009-2) [1217b8f] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: ba81adbe-b311-4aef-b6c1-5f84f0f3c94d Type: VM >2012-08-06 11:46:59,965 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp--127.0.0.1-8009-2) [1217b8f] MacPoolManager::allocateNewMac entered >2012-08-06 11:46:59,967 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp--127.0.0.1-8009-2) [1217b8f] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:69 >2012-08-06 11:47:01,731 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-6) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 26c2e644 >2012-08-06 11:47:02,627 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-6) FINISH, GetDeviceListVDSCommand, return: [], log id: 26c2e644 >2012-08-06 11:47:10,719 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-3) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 407b49a0 >2012-08-06 11:47:11,540 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-3) FINISH, GetDeviceListVDSCommand, return: [], log id: 407b49a0 >2012-08-06 11:47:29,433 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-6) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 40a83989 >2012-08-06 11:47:30,279 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-6) FINISH, GetDeviceListVDSCommand, return: [], log id: 40a83989 >2012-08-06 11:47:56,516 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-12) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 67d26353 >2012-08-06 11:47:57,397 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-12) FINISH, GetDeviceListVDSCommand, return: [], log id: 67d26353 >2012-08-06 11:48:12,340 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8009-1) [672bd3db] Lock Acquired to object EngineLock [exclusiveLocks= key: ggggg value: VM_NAME >, sharedLocks= ] >2012-08-06 11:48:12,390 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-1) [672bd3db] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 68f4c071 >2012-08-06 11:48:12,393 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-1) [672bd3db] FINISH, IsValidVDSCommand, return: true, log id: 68f4c071 >2012-08-06 11:48:12,415 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8009-1) [672bd3db] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups >2012-08-06 11:48:12,421 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-1) [672bd3db] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 2a107c3b >2012-08-06 11:48:12,426 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-1) [672bd3db] FINISH, IsValidVDSCommand, return: true, log id: 2a107c3b >2012-08-06 11:48:12,511 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8009-1) [672bd3db] Lock freed to object EngineLock [exclusiveLocks= key: ggggg value: VM_NAME >, sharedLocks= ] >2012-08-06 11:48:14,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-10) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 1fb91fa2 >2012-08-06 11:48:14,949 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-10) FINISH, GetDeviceListVDSCommand, return: [], log id: 1fb91fa2 >2012-08-06 11:48:54,994 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-6) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 2a548392 >2012-08-06 11:48:55,825 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-6) FINISH, GetDeviceListVDSCommand, return: [], log id: 2a548392 >2012-08-06 11:49:55,782 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-1) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 4170927e >2012-08-06 11:49:56,583 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-1) FINISH, GetDeviceListVDSCommand, return: [], log id: 4170927e >2012-08-06 11:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable hosts >2012-08-06 11:50:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Autorecovering 0 hosts >2012-08-06 11:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable hosts done >2012-08-06 11:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable storage domains >2012-08-06 11:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Autorecovering 0 storage domains >2012-08-06 11:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable storage domains done >2012-08-06 11:51:58,975 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-2) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 138e2336 >2012-08-06 11:51:58,989 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-9) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 38d50d5f >2012-08-06 11:52:00,257 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-2) FINISH, GetDeviceListVDSCommand, return: [], log id: 138e2336 >2012-08-06 11:52:00,777 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-9) FINISH, GetDeviceListVDSCommand, return: [], log id: 38d50d5f >2012-08-06 11:52:26,311 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-2) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 6e01fce0 >2012-08-06 11:52:26,335 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-6) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 57e88877 >2012-08-06 11:52:27,125 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-2) FINISH, GetDeviceListVDSCommand, return: [], log id: 6e01fce0 >2012-08-06 11:52:27,556 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-6) FINISH, GetDeviceListVDSCommand, return: [], log id: 57e88877 >2012-08-06 11:52:30,275 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-9) START, GetDeviceListVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storageType=ISCSI), log id: 2fb5e3c >2012-08-06 11:52:32,480 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-9) FINISH, GetDeviceListVDSCommand, return: [], log id: 2fb5e3c >2012-08-06 11:52:39,822 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-3) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 4b175c4e >2012-08-06 11:52:40,660 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-3) FINISH, GetDeviceListVDSCommand, return: [], log id: 4b175c4e >2012-08-06 11:52:49,701 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-2) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 5ba1406b >2012-08-06 11:52:50,524 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-2) FINISH, GetDeviceListVDSCommand, return: [], log id: 5ba1406b >2012-08-06 11:52:54,555 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-12) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 136a1688 >2012-08-06 11:52:55,438 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-12) FINISH, GetDeviceListVDSCommand, return: [], log id: 136a1688 >2012-08-06 11:52:59,180 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-8) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 280001a4 >2012-08-06 11:53:00,175 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-8) FINISH, GetDeviceListVDSCommand, return: [], log id: 280001a4 >2012-08-06 11:53:02,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-7) START, GetDeviceListVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storageType=ISCSI), log id: 5b3a1d4a >2012-08-06 11:53:04,287 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-7) FINISH, GetDeviceListVDSCommand, return: [], log id: 5b3a1d4a >2012-08-06 11:53:22,183 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (ajp--127.0.0.1-8009-9) Lock Acquired to object EngineLock [exclusiveLocks= key: 3423dfa5-a9d4-4462-9ea4-4a5bdbad480e value: VM >, sharedLocks= ] >2012-08-06 11:53:22,225 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-9) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 51b63ef5 >2012-08-06 11:53:22,226 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-9) FINISH, IsValidVDSCommand, return: true, log id: 51b63ef5 >2012-08-06 11:53:22,335 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-50) [3e00813] Running command: RemoveVmCommand internal: false. Entities affected : ID: 3423dfa5-a9d4-4462-9ea4-4a5bdbad480e Type: VM >2012-08-06 11:53:22,375 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [3e00813] START, SetVmStatusVDSCommand(vmId = 3423dfa5-a9d4-4462-9ea4-4a5bdbad480e, status = ImageLocked), log id: 157dd183 >2012-08-06 11:53:22,404 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [3e00813] FINISH, SetVmStatusVDSCommand, log id: 157dd183 >2012-08-06 11:53:22,422 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-50) [3e00813] Lock freed to object EngineLock [exclusiveLocks= key: 3423dfa5-a9d4-4462-9ea4-4a5bdbad480e value: VM >, sharedLocks= ] >2012-08-06 11:53:22,424 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-50) [3e00813] START, RemoveVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = 3423dfa5-a9d4-4462-9ea4-4a5bdbad480e), log id: 74a0125c >2012-08-06 11:53:22,515 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-50) [3e00813] FINISH, RemoveVMVDSCommand, log id: 74a0125c >2012-08-06 11:53:29,784 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-11) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 31c7a267 >2012-08-06 11:53:29,981 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-8) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 5da0d6d5 >2012-08-06 11:53:30,630 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-11) FINISH, GetDeviceListVDSCommand, return: [], log id: 31c7a267 >2012-08-06 11:53:31,084 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-8) FINISH, GetDeviceListVDSCommand, return: [], log id: 5da0d6d5 >2012-08-06 11:53:35,277 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-8) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 36e676b >2012-08-06 11:53:35,278 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-10) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 624324d1 >2012-08-06 11:53:36,155 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-8) FINISH, GetDeviceListVDSCommand, return: [], log id: 36e676b >2012-08-06 11:53:36,586 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-10) FINISH, GetDeviceListVDSCommand, return: [], log id: 624324d1 >2012-08-06 11:53:44,875 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-7) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 5170b7d6 >2012-08-06 11:53:45,723 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-7) FINISH, GetDeviceListVDSCommand, return: [], log id: 5170b7d6 >2012-08-06 11:54:01,940 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8009-3) Lock Acquired to object EngineLock [exclusiveLocks= key: ba81adbe-b311-4aef-b6c1-5f84f0f3c94d value: VM_DISK_BOOT >, sharedLocks= key: ba81adbe-b311-4aef-b6c1-5f84f0f3c94d value: VM >] >2012-08-06 11:54:01,968 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-3) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1ab5f0f1 >2012-08-06 11:54:01,970 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-3) FINISH, IsValidVDSCommand, return: true, log id: 1ab5f0f1 >2012-08-06 11:54:02,078 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-3-thread-50) [dc32001] Running command: AddDiskCommand internal: false. Entities affected : ID: ba81adbe-b311-4aef-b6c1-5f84f0f3c94d Type: VM, ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 11:54:02,224 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-50) [2c8eafbd] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 11:54:02,276 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-50) [2c8eafbd] Lock freed to object EngineLock [exclusiveLocks= key: ba81adbe-b311-4aef-b6c1-5f84f0f3c94d value: VM_DISK_BOOT >, sharedLocks= key: ba81adbe-b311-4aef-b6c1-5f84f0f3c94d value: VM >] >2012-08-06 11:54:02,279 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-50) [2c8eafbd] START, CreateImageVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 9c931956-f081-4418-afc2-ce5f5cfa132f, imageSizeInBytes = 1073741824, volumeFormat = RAW, newImageId = 33107dbd-e746-4c65-ba13-7c1c2c5af3a1, newImageDescription = ), log id: 6f6874f5 >2012-08-06 11:54:02,281 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-50) [2c8eafbd] -- CreateImageVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 11:54:02,282 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-50) [2c8eafbd] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=9c931956-f081-4418-afc2-ce5f5cfa132f > size=1,073,741,824 bytes > volFormat=RAW > volType=Sparse > volUUID=33107dbd-e746-4c65-ba13-7c1c2c5af3a1 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2012-08-06 11:54:03,047 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-50) [2c8eafbd] FINISH, CreateImageVDSCommand, return: 33107dbd-e746-4c65-ba13-7c1c2c5af3a1, log id: 6f6874f5 >2012-08-06 11:54:03,074 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) [2c8eafbd] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 9c931956-f081-4418-afc2-ce5f5cfa132f >2012-08-06 11:54:03,075 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [2c8eafbd] EntityMultiAsyncTasks::AttachTask: Attaching task f4f130f9-e3d6-4293-aafe-feb14ad5972b to entity 9c931956-f081-4418-afc2-ce5f5cfa132f. >2012-08-06 11:54:03,083 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-50) [2c8eafbd] Adding task f4f130f9-e3d6-4293-aafe-feb14ad5972b to DataBase >2012-08-06 11:54:03,190 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-50) [2c8eafbd] Adding task f4f130f9-e3d6-4293-aafe-feb14ad5972b (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 11:54:03,435 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) [2c8eafbd] BaseAsyncTask::StartPollingTask: Starting to poll task f4f130f9-e3d6-4293-aafe-feb14ad5972b. >2012-08-06 11:54:03,435 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [2c8eafbd] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 9c931956-f081-4418-afc2-ce5f5cfa132f is AddDisk (determined by task f4f130f9-e3d6-4293-aafe-feb14ad5972b) >2012-08-06 11:54:08,595 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-53) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2012-08-06 11:54:08,624 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-53) SPMAsyncTask::PollTask: Polling task f4f130f9-e3d6-4293-aafe-feb14ad5972b (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 11:54:08,643 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-53) BaseAsyncTask::OnTaskEndSuccess: Task f4f130f9-e3d6-4293-aafe-feb14ad5972b (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 11:54:08,644 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-53) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 9c931956-f081-4418-afc2-ce5f5cfa132f has ended -> executing EndAction >2012-08-06 11:54:08,645 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-53) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 9c931956-f081-4418-afc2-ce5f5cfa132f): calling EndAction for action type AddDisk. >2012-08-06 11:54:08,647 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddDisk >2012-08-06 11:54:08,675 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-3-thread-48) Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2012-08-06 11:54:08,676 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-48) [2c8eafbd] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2012-08-06 11:54:08,687 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [2c8eafbd] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 9c931956-f081-4418-afc2-ce5f5cfa132f, imageId = 33107dbd-e746-4c65-ba13-7c1c2c5af3a1), log id: 63909527 >2012-08-06 11:54:08,742 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [2c8eafbd] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@946d66ec, log id: 63909527 >2012-08-06 11:54:09,014 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-48) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 5305042d >2012-08-06 11:54:09,063 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-48) FINISH, UpdateVMVDSCommand, log id: 5305042d >2012-08-06 11:54:09,138 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk completed, handling the result. >2012-08-06 11:54:09,138 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk succeeded, clearing tasks. >2012-08-06 11:54:09,160 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task f4f130f9-e3d6-4293-aafe-feb14ad5972b >2012-08-06 11:54:09,162 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-48) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = f4f130f9-e3d6-4293-aafe-feb14ad5972b), log id: 199d592 >2012-08-06 11:54:09,170 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-48) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=f4f130f9-e3d6-4293-aafe-feb14ad5972b), log id: e35da69 >2012-08-06 11:54:09,213 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-48) FINISH, HSMClearTaskVDSCommand, log id: e35da69 >2012-08-06 11:54:09,214 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 199d592 >2012-08-06 11:54:09,234 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task f4f130f9-e3d6-4293-aafe-feb14ad5972b from DataBase >2012-08-06 11:54:09,235 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 9c931956-f081-4418-afc2-ce5f5cfa132f >2012-08-06 11:54:43,124 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-12) [4a6878d3] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 54268560 >2012-08-06 11:54:43,126 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-12) [4a6878d3] FINISH, IsValidVDSCommand, return: true, log id: 54268560 >2012-08-06 11:54:43,153 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (ajp--127.0.0.1-8009-12) [4a6878d3] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 9c931956-f081-4418-afc2-ce5f5cfa132f, imageId = 33107dbd-e746-4c65-ba13-7c1c2c5af3a1), log id: 4c95caff >2012-08-06 11:54:43,205 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (ajp--127.0.0.1-8009-12) [4a6878d3] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@946d66ec, log id: 4c95caff >2012-08-06 11:54:43,255 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] (ajp--127.0.0.1-8009-12) [4a6878d3] Running command: AddVmTemplateCommand internal: false. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-06 11:54:43,264 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (ajp--127.0.0.1-8009-12) [4a6878d3] START, SetVmStatusVDSCommand(vmId = ba81adbe-b311-4aef-b6c1-5f84f0f3c94d, status = ImageLocked), log id: ea25b82 >2012-08-06 11:54:43,277 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (ajp--127.0.0.1-8009-12) [4a6878d3] FINISH, SetVmStatusVDSCommand, log id: ea25b82 >2012-08-06 11:54:43,324 INFO [org.ovirt.engine.core.bll.CreateImageTemplateCommand] (ajp--127.0.0.1-8009-12) [7aed83fb] Running command: CreateImageTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 11:54:43,337 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (ajp--127.0.0.1-8009-12) [7aed83fb] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 9c931956-f081-4418-afc2-ce5f5cfa132f, imageId = 33107dbd-e746-4c65-ba13-7c1c2c5af3a1), log id: 5c334196 >2012-08-06 11:54:43,391 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (ajp--127.0.0.1-8009-12) [7aed83fb] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@946d66ec, log id: 5c334196 >2012-08-06 11:54:43,406 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (ajp--127.0.0.1-8009-12) [7aed83fb] START, CopyImageVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 9c931956-f081-4418-afc2-ce5f5cfa132f, imageId = 33107dbd-e746-4c65-ba13-7c1c2c5af3a1, dstImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, vmId = ba81adbe-b311-4aef-b6c1-5f84f0f3c94d, dstImageId = bd6ab252-3a6a-4b62-adef-d865868df674, imageDescription = Active VM, dstStorageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, copyVolumeType = SharedVol, volumeFormat = RAW, preallocate = Sparse, postZero = false, force = false), log id: 7c78d80d >2012-08-06 11:54:43,408 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (ajp--127.0.0.1-8009-12) [7aed83fb] -- CopyImageVDSCommand::ExecuteIrsBrokerCommand: calling 'copyImage' with two new parameters: description and UUID >2012-08-06 11:54:43,409 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (ajp--127.0.0.1-8009-12) [7aed83fb] -- copyImage parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > vmGUID=ba81adbe-b311-4aef-b6c1-5f84f0f3c94d > srcImageGUID=9c931956-f081-4418-afc2-ce5f5cfa132f > srcVolUUID=33107dbd-e746-4c65-ba13-7c1c2c5af3a1 > dstImageGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > dstVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > descr=Active VM > >2012-08-06 11:54:44,256 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (ajp--127.0.0.1-8009-12) [7aed83fb] FINISH, CopyImageVDSCommand, return: 00000000-0000-0000-0000-000000000000, log id: 7c78d80d >2012-08-06 11:54:44,280 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (ajp--127.0.0.1-8009-12) [7aed83fb] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 574ff868-ed01-4038-93cc-f4fbfad23445 >2012-08-06 11:54:44,281 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (ajp--127.0.0.1-8009-12) [7aed83fb] EntityMultiAsyncTasks::AttachTask: Attaching task 44d14917-da5a-4fdc-800c-3da1518ebef2 to entity 574ff868-ed01-4038-93cc-f4fbfad23445. >2012-08-06 11:54:44,283 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (ajp--127.0.0.1-8009-12) [7aed83fb] Adding task 44d14917-da5a-4fdc-800c-3da1518ebef2 to DataBase >2012-08-06 11:54:44,337 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp--127.0.0.1-8009-12) [7aed83fb] Adding task 44d14917-da5a-4fdc-800c-3da1518ebef2 (Parent Command AddVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 11:54:44,492 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp--127.0.0.1-8009-12) [7aed83fb] BaseAsyncTask::StartPollingTask: Starting to poll task 44d14917-da5a-4fdc-800c-3da1518ebef2. >2012-08-06 11:54:44,493 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (ajp--127.0.0.1-8009-12) [7aed83fb] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 574ff868-ed01-4038-93cc-f4fbfad23445 is AddVmTemplate (determined by task 44d14917-da5a-4fdc-800c-3da1518ebef2) >2012-08-06 11:54:48,653 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-36) Polling and updating Async Tasks: 2 tasks, 1 tasks to poll now >2012-08-06 11:54:48,690 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-36) SPMAsyncTask::PollTask: Polling task 44d14917-da5a-4fdc-800c-3da1518ebef2 (Parent Command AddVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2012-08-06 11:54:48,691 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-36) Finished polling Tasks, will poll again in 10 seconds. >2012-08-06 11:54:58,716 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-74) SPMAsyncTask::PollTask: Polling task 44d14917-da5a-4fdc-800c-3da1518ebef2 (Parent Command AddVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 11:54:58,749 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-74) BaseAsyncTask::OnTaskEndSuccess: Task 44d14917-da5a-4fdc-800c-3da1518ebef2 (Parent Command AddVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 11:54:58,751 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-74) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 574ff868-ed01-4038-93cc-f4fbfad23445 has ended -> executing EndAction >2012-08-06 11:54:58,751 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-74) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 574ff868-ed01-4038-93cc-f4fbfad23445): calling EndAction for action type AddVmTemplate. >2012-08-06 11:54:58,752 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVmTemplate >2012-08-06 11:54:58,786 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] (pool-3-thread-50) [4a6878d3] Ending command successfully: org.ovirt.engine.core.bll.AddVmTemplateCommand >2012-08-06 11:54:58,786 INFO [org.ovirt.engine.core.bll.CreateImageTemplateCommand] (pool-3-thread-50) [7aed83fb] Ending command successfully: org.ovirt.engine.core.bll.CreateImageTemplateCommand >2012-08-06 11:54:58,789 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [7aed83fb] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 6b21f53f >2012-08-06 11:54:58,842 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [7aed83fb] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@cf22de24, log id: 6b21f53f >2012-08-06 11:54:58,870 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-50) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 28f47207 >2012-08-06 11:54:58,983 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-50) FINISH, UpdateVMVDSCommand, log id: 28f47207 >2012-08-06 11:54:58,984 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) START, SetVmStatusVDSCommand(vmId = ba81adbe-b311-4aef-b6c1-5f84f0f3c94d, status = Down), log id: 486a3e92 >2012-08-06 11:54:58,989 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) FINISH, SetVmStatusVDSCommand, log id: 486a3e92 >2012-08-06 11:54:59,080 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVmTemplate completed, handling the result. >2012-08-06 11:54:59,080 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVmTemplate succeeded, clearing tasks. >2012-08-06 11:54:59,096 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 44d14917-da5a-4fdc-800c-3da1518ebef2 >2012-08-06 11:54:59,096 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-50) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 44d14917-da5a-4fdc-800c-3da1518ebef2), log id: bceb742 >2012-08-06 11:54:59,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-50) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=44d14917-da5a-4fdc-800c-3da1518ebef2), log id: 2b95874c >2012-08-06 11:54:59,146 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 2b95874c >2012-08-06 11:54:59,147 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-50) FINISH, SPMClearTaskVDSCommand, log id: bceb742 >2012-08-06 11:54:59,170 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task 44d14917-da5a-4fdc-800c-3da1518ebef2 from DataBase >2012-08-06 11:54:59,170 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 574ff868-ed01-4038-93cc-f4fbfad23445 >2012-08-06 11:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable hosts >2012-08-06 11:55:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Autorecovering 0 hosts >2012-08-06 11:55:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable hosts done >2012-08-06 11:55:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable storage domains >2012-08-06 11:55:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Autorecovering 0 storage domains >2012-08-06 11:55:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable storage domains done >2012-08-06 11:55:26,834 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-97) Setting new tasks map. The map contains now 1 tasks >2012-08-06 11:55:51,645 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-12) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 282cf595 >2012-08-06 11:55:51,651 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-12) FINISH, IsValidVDSCommand, return: true, log id: 282cf595 >2012-08-06 11:55:51,656 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-12) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 21f4b5d2 >2012-08-06 11:55:51,658 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-12) FINISH, IsValidVDSCommand, return: true, log id: 21f4b5d2 >2012-08-06 11:55:51,773 INFO [org.ovirt.engine.core.bll.AddVmPoolWithVmsCommand] (pool-3-thread-48) [6b583e0e] Running command: AddVmPoolWithVmsCommand internal: false. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate >2012-08-06 11:55:51,900 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [5c2b6f38] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 48214b18 >2012-08-06 11:55:51,902 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [5c2b6f38] FINISH, IsValidVDSCommand, return: true, log id: 48214b18 >2012-08-06 11:55:51,995 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-48) [5c2b6f38] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:55:52,008 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [491c7a3f] Lock Acquired to object EngineLock [exclusiveLocks= key: pool-1 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:55:52,028 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [491c7a3f] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 648a5873 >2012-08-06 11:55:52,030 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [491c7a3f] FINISH, IsValidVDSCommand, return: true, log id: 648a5873 >2012-08-06 11:55:52,031 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [491c7a3f] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:55:52,033 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [491c7a3f] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 973d34 >2012-08-06 11:55:52,035 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [491c7a3f] FINISH, IsValidVDSCommand, return: true, log id: 973d34 >2012-08-06 11:55:52,041 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [491c7a3f] MacPoolManager::allocateNewMac entered >2012-08-06 11:55:52,041 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [491c7a3f] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:68 >2012-08-06 11:55:52,069 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [491c7a3f] Lock freed to object EngineLock [exclusiveLocks= key: pool-1 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:55:52,070 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [491c7a3f] START, SetVmStatusVDSCommand(vmId = 6a8ef0f6-c139-41d9-a814-60ca51daa5f4, status = ImageLocked), log id: 5a6a8d1c >2012-08-06 11:55:52,075 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [491c7a3f] FINISH, SetVmStatusVDSCommand, log id: 5a6a8d1c >2012-08-06 11:55:52,078 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-48) [167f1eb0] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 11:55:52,085 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [167f1eb0] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 26136142 >2012-08-06 11:55:52,138 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [167f1eb0] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@cf22de24, log id: 26136142 >2012-08-06 11:55:52,143 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [167f1eb0] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 3e3d72e9-e806-4e3d-810f-279907509728, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 4b5d3e84-ae11-4ed4-808a-997d2f2a773b, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 754a57b1 >2012-08-06 11:55:52,145 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [167f1eb0] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 11:55:52,146 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [167f1eb0] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=3e3d72e9-e806-4e3d-810f-279907509728 > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=4b5d3e84-ae11-4ed4-808a-997d2f2a773b > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 11:55:52,460 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [167f1eb0] FINISH, CreateSnapshotVDSCommand, return: 4b5d3e84-ae11-4ed4-808a-997d2f2a773b, log id: 754a57b1 >2012-08-06 11:55:52,507 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) [167f1eb0] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 6a8ef0f6-c139-41d9-a814-60ca51daa5f4 >2012-08-06 11:55:52,508 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [167f1eb0] EntityMultiAsyncTasks::AttachTask: Attaching task 79cc8a94-947c-4671-ae95-4e03cdf4e059 to entity 6a8ef0f6-c139-41d9-a814-60ca51daa5f4. >2012-08-06 11:55:52,510 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-48) [167f1eb0] Adding task 79cc8a94-947c-4671-ae95-4e03cdf4e059 to DataBase >2012-08-06 11:55:52,615 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-48) [167f1eb0] Adding task 79cc8a94-947c-4671-ae95-4e03cdf4e059 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 11:55:52,887 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) [167f1eb0] BaseAsyncTask::StartPollingTask: Starting to poll task 79cc8a94-947c-4671-ae95-4e03cdf4e059. >2012-08-06 11:55:52,888 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [167f1eb0] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 6a8ef0f6-c139-41d9-a814-60ca51daa5f4 is AddVm (determined by task 79cc8a94-947c-4671-ae95-4e03cdf4e059) >2012-08-06 11:55:52,924 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-48) [622bf809] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 11:55:53,050 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [17884043] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6b0b1504 >2012-08-06 11:55:53,052 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [17884043] FINISH, IsValidVDSCommand, return: true, log id: 6b0b1504 >2012-08-06 11:55:53,137 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-48) [17884043] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:55:53,153 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [48ed62d0] Lock Acquired to object EngineLock [exclusiveLocks= key: pool-2 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:55:53,211 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [48ed62d0] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 779be0dd >2012-08-06 11:55:53,212 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [48ed62d0] FINISH, IsValidVDSCommand, return: true, log id: 779be0dd >2012-08-06 11:55:53,214 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [48ed62d0] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:55:53,216 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [48ed62d0] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 5fed84ae >2012-08-06 11:55:53,220 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [48ed62d0] FINISH, IsValidVDSCommand, return: true, log id: 5fed84ae >2012-08-06 11:55:53,231 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [48ed62d0] MacPoolManager::allocateNewMac entered >2012-08-06 11:55:53,231 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [48ed62d0] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:67 >2012-08-06 11:55:53,301 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [48ed62d0] Lock freed to object EngineLock [exclusiveLocks= key: pool-2 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:55:53,302 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [48ed62d0] START, SetVmStatusVDSCommand(vmId = 3c5452c9-a5e2-46af-90b5-b568da5dc3d4, status = ImageLocked), log id: 5d1abe60 >2012-08-06 11:55:53,311 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [48ed62d0] FINISH, SetVmStatusVDSCommand, log id: 5d1abe60 >2012-08-06 11:55:53,316 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-48) [7747270b] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 11:55:53,318 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [7747270b] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 26848f00 >2012-08-06 11:55:53,391 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [7747270b] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@cf22de24, log id: 26848f00 >2012-08-06 11:55:53,397 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [7747270b] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 39207fa9-2d8b-4c91-a8d6-79bc119b38dd, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 1f61f361-5277-4e06-b61a-443dea553032, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 53fa8add >2012-08-06 11:55:53,399 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [7747270b] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 11:55:53,400 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [7747270b] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=39207fa9-2d8b-4c91-a8d6-79bc119b38dd > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=1f61f361-5277-4e06-b61a-443dea553032 > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 11:55:53,917 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [7747270b] FINISH, CreateSnapshotVDSCommand, return: 1f61f361-5277-4e06-b61a-443dea553032, log id: 53fa8add >2012-08-06 11:55:53,934 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) [7747270b] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 >2012-08-06 11:55:53,935 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [7747270b] EntityMultiAsyncTasks::AttachTask: Attaching task eaf32b47-8f22-4dc9-aaed-dc2e6d178d55 to entity 3c5452c9-a5e2-46af-90b5-b568da5dc3d4. >2012-08-06 11:55:53,936 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-48) [7747270b] Adding task eaf32b47-8f22-4dc9-aaed-dc2e6d178d55 to DataBase >2012-08-06 11:55:54,036 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-48) [7747270b] Adding task eaf32b47-8f22-4dc9-aaed-dc2e6d178d55 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 11:55:54,255 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) [7747270b] BaseAsyncTask::StartPollingTask: Starting to poll task eaf32b47-8f22-4dc9-aaed-dc2e6d178d55. >2012-08-06 11:55:54,256 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [7747270b] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 is AddVm (determined by task eaf32b47-8f22-4dc9-aaed-dc2e6d178d55) >2012-08-06 11:55:54,269 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-48) [711b9f7d] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 11:55:54,394 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [6459ade] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 13ddae14 >2012-08-06 11:55:54,396 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [6459ade] FINISH, IsValidVDSCommand, return: true, log id: 13ddae14 >2012-08-06 11:55:54,452 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-48) [6459ade] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:55:54,461 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [29baa020] Lock Acquired to object EngineLock [exclusiveLocks= key: pool-3 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:55:54,487 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [29baa020] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: fa4fa38 >2012-08-06 11:55:54,489 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [29baa020] FINISH, IsValidVDSCommand, return: true, log id: fa4fa38 >2012-08-06 11:55:54,490 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [29baa020] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:55:54,493 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [29baa020] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4b28c5f8 >2012-08-06 11:55:54,494 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [29baa020] FINISH, IsValidVDSCommand, return: true, log id: 4b28c5f8 >2012-08-06 11:55:54,499 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [29baa020] MacPoolManager::allocateNewMac entered >2012-08-06 11:55:54,499 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [29baa020] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:66 >2012-08-06 11:55:54,542 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [29baa020] Lock freed to object EngineLock [exclusiveLocks= key: pool-3 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:55:54,542 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [29baa020] START, SetVmStatusVDSCommand(vmId = 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3, status = ImageLocked), log id: 6fcc07ff >2012-08-06 11:55:54,546 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [29baa020] FINISH, SetVmStatusVDSCommand, log id: 6fcc07ff >2012-08-06 11:55:54,547 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-48) [56ad8e84] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 11:55:54,549 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [56ad8e84] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 4c255d90 >2012-08-06 11:55:54,596 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [56ad8e84] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@cf22de24, log id: 4c255d90 >2012-08-06 11:55:54,598 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [56ad8e84] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = c11fe8ad-261d-4b34-a034-e5772dc3305d, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = e7ddb179-c2d5-4a8d-ad54-1c7827aec960, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 30d1e052 >2012-08-06 11:55:54,600 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [56ad8e84] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 11:55:54,601 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [56ad8e84] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=c11fe8ad-261d-4b34-a034-e5772dc3305d > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=e7ddb179-c2d5-4a8d-ad54-1c7827aec960 > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 11:55:54,869 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [56ad8e84] FINISH, CreateSnapshotVDSCommand, return: e7ddb179-c2d5-4a8d-ad54-1c7827aec960, log id: 30d1e052 >2012-08-06 11:55:54,885 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) [56ad8e84] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3 >2012-08-06 11:55:54,886 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [56ad8e84] EntityMultiAsyncTasks::AttachTask: Attaching task 36dc6693-4b53-4505-8277-aaac34127679 to entity 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3. >2012-08-06 11:55:54,887 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-48) [56ad8e84] Adding task 36dc6693-4b53-4505-8277-aaac34127679 to DataBase >2012-08-06 11:55:54,974 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-48) [56ad8e84] Adding task 36dc6693-4b53-4505-8277-aaac34127679 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 11:55:55,192 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) [56ad8e84] BaseAsyncTask::StartPollingTask: Starting to poll task 36dc6693-4b53-4505-8277-aaac34127679. >2012-08-06 11:55:55,192 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [56ad8e84] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3 is AddVm (determined by task 36dc6693-4b53-4505-8277-aaac34127679) >2012-08-06 11:55:55,203 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-48) [4be943bf] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 11:55:55,337 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [26d9a106] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1966e646 >2012-08-06 11:55:55,338 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [26d9a106] FINISH, IsValidVDSCommand, return: true, log id: 1966e646 >2012-08-06 11:55:55,467 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-48) [26d9a106] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:55:55,483 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [600b8c9e] Lock Acquired to object EngineLock [exclusiveLocks= key: pool-4 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:55:55,566 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [600b8c9e] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 7f1a9501 >2012-08-06 11:55:55,568 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [600b8c9e] FINISH, IsValidVDSCommand, return: true, log id: 7f1a9501 >2012-08-06 11:55:55,570 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [600b8c9e] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:55:55,571 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [600b8c9e] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 7015adba >2012-08-06 11:55:55,573 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [600b8c9e] FINISH, IsValidVDSCommand, return: true, log id: 7015adba >2012-08-06 11:55:55,577 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [600b8c9e] MacPoolManager::allocateNewMac entered >2012-08-06 11:55:55,578 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [600b8c9e] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:65 >2012-08-06 11:55:55,638 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [600b8c9e] Lock freed to object EngineLock [exclusiveLocks= key: pool-4 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:55:55,638 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [600b8c9e] START, SetVmStatusVDSCommand(vmId = e047ae8c-befe-4805-bc8c-929bb3408fbe, status = ImageLocked), log id: 2a2b4bbd >2012-08-06 11:55:55,645 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [600b8c9e] FINISH, SetVmStatusVDSCommand, log id: 2a2b4bbd >2012-08-06 11:55:55,650 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-48) [3b439a6] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 11:55:55,654 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [3b439a6] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 1c7553f0 >2012-08-06 11:55:55,715 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [3b439a6] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@cf22de24, log id: 1c7553f0 >2012-08-06 11:55:55,717 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [3b439a6] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = defea5bf-fa7b-4b85-acb3-bab8d91c9966, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 67b83e74-781d-4c05-a6a9-17125d15753f, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 5c94aec6 >2012-08-06 11:55:55,719 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [3b439a6] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 11:55:55,720 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [3b439a6] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=defea5bf-fa7b-4b85-acb3-bab8d91c9966 > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=67b83e74-781d-4c05-a6a9-17125d15753f > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 11:55:55,989 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [3b439a6] FINISH, CreateSnapshotVDSCommand, return: 67b83e74-781d-4c05-a6a9-17125d15753f, log id: 5c94aec6 >2012-08-06 11:55:56,010 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) [3b439a6] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity e047ae8c-befe-4805-bc8c-929bb3408fbe >2012-08-06 11:55:56,011 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [3b439a6] EntityMultiAsyncTasks::AttachTask: Attaching task aea05448-9988-401b-851a-6fb9a08a11e7 to entity e047ae8c-befe-4805-bc8c-929bb3408fbe. >2012-08-06 11:55:56,012 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-48) [3b439a6] Adding task aea05448-9988-401b-851a-6fb9a08a11e7 to DataBase >2012-08-06 11:55:56,084 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-48) [3b439a6] Adding task aea05448-9988-401b-851a-6fb9a08a11e7 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 11:55:56,332 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) [3b439a6] BaseAsyncTask::StartPollingTask: Starting to poll task aea05448-9988-401b-851a-6fb9a08a11e7. >2012-08-06 11:55:56,333 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [3b439a6] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity e047ae8c-befe-4805-bc8c-929bb3408fbe is AddVm (determined by task aea05448-9988-401b-851a-6fb9a08a11e7) >2012-08-06 11:55:56,343 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-48) [76354c4d] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 11:55:56,428 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [3752084] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 29212f02 >2012-08-06 11:55:56,430 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [3752084] FINISH, IsValidVDSCommand, return: true, log id: 29212f02 >2012-08-06 11:55:56,489 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-48) [3752084] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:55:56,497 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [85fe0d1] Lock Acquired to object EngineLock [exclusiveLocks= key: pool-5 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:55:56,517 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [85fe0d1] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4cf671b4 >2012-08-06 11:55:56,518 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [85fe0d1] FINISH, IsValidVDSCommand, return: true, log id: 4cf671b4 >2012-08-06 11:55:56,520 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [85fe0d1] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:55:56,525 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [85fe0d1] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 5cd25082 >2012-08-06 11:55:56,527 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [85fe0d1] FINISH, IsValidVDSCommand, return: true, log id: 5cd25082 >2012-08-06 11:55:56,542 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [85fe0d1] MacPoolManager::allocateNewMac entered >2012-08-06 11:55:56,543 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [85fe0d1] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:64 >2012-08-06 11:55:56,599 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [85fe0d1] Lock freed to object EngineLock [exclusiveLocks= key: pool-5 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:55:56,600 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [85fe0d1] START, SetVmStatusVDSCommand(vmId = 4dfd7e9a-0245-403d-8fe6-f415f61121af, status = ImageLocked), log id: 1ac97ca9 >2012-08-06 11:55:56,611 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [85fe0d1] FINISH, SetVmStatusVDSCommand, log id: 1ac97ca9 >2012-08-06 11:55:56,617 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-48) [6cfe3a1b] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 11:55:56,623 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [6cfe3a1b] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 6a6d702a >2012-08-06 11:55:56,722 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [6cfe3a1b] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@cf22de24, log id: 6a6d702a >2012-08-06 11:55:56,728 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [6cfe3a1b] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 7e1d2bb1-9a49-4c3a-914d-8604d49f9f5f, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 9526aacf-a526-4dc6-a2f0-625ec7dfef12, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 69857c1d >2012-08-06 11:55:56,730 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [6cfe3a1b] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 11:55:56,731 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [6cfe3a1b] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=7e1d2bb1-9a49-4c3a-914d-8604d49f9f5f > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=9526aacf-a526-4dc6-a2f0-625ec7dfef12 > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 11:55:57,150 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [6cfe3a1b] FINISH, CreateSnapshotVDSCommand, return: 9526aacf-a526-4dc6-a2f0-625ec7dfef12, log id: 69857c1d >2012-08-06 11:55:57,408 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) [6cfe3a1b] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 4dfd7e9a-0245-403d-8fe6-f415f61121af >2012-08-06 11:55:57,409 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [6cfe3a1b] EntityMultiAsyncTasks::AttachTask: Attaching task b683051b-a9ac-4427-a593-22559e2ce34d to entity 4dfd7e9a-0245-403d-8fe6-f415f61121af. >2012-08-06 11:55:57,411 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-48) [6cfe3a1b] Adding task b683051b-a9ac-4427-a593-22559e2ce34d to DataBase >2012-08-06 11:55:57,463 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-48) [6cfe3a1b] Adding task b683051b-a9ac-4427-a593-22559e2ce34d (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 11:55:57,632 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) [6cfe3a1b] BaseAsyncTask::StartPollingTask: Starting to poll task b683051b-a9ac-4427-a593-22559e2ce34d. >2012-08-06 11:55:57,633 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [6cfe3a1b] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 4dfd7e9a-0245-403d-8fe6-f415f61121af is AddVm (determined by task b683051b-a9ac-4427-a593-22559e2ce34d) >2012-08-06 11:55:57,640 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-48) [7117120e] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 11:55:57,787 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [f82621f] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 45e573b2 >2012-08-06 11:55:57,789 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [f82621f] FINISH, IsValidVDSCommand, return: true, log id: 45e573b2 >2012-08-06 11:55:57,856 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-48) [f82621f] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:55:57,865 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [35fc50db] Lock Acquired to object EngineLock [exclusiveLocks= key: pool-6 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:55:57,887 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [35fc50db] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 21a8f60e >2012-08-06 11:55:57,889 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [35fc50db] FINISH, IsValidVDSCommand, return: true, log id: 21a8f60e >2012-08-06 11:55:57,890 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [35fc50db] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:55:57,892 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [35fc50db] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 2e8707ac >2012-08-06 11:55:57,894 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [35fc50db] FINISH, IsValidVDSCommand, return: true, log id: 2e8707ac >2012-08-06 11:55:57,900 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [35fc50db] MacPoolManager::allocateNewMac entered >2012-08-06 11:55:57,900 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [35fc50db] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:63 >2012-08-06 11:55:57,934 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [35fc50db] Lock freed to object EngineLock [exclusiveLocks= key: pool-6 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:55:57,934 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [35fc50db] START, SetVmStatusVDSCommand(vmId = 10ef6062-3141-48a6-a778-c79f7a47154e, status = ImageLocked), log id: 7633cc11 >2012-08-06 11:55:57,937 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [35fc50db] FINISH, SetVmStatusVDSCommand, log id: 7633cc11 >2012-08-06 11:55:57,938 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-48) [5712a30d] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 11:55:57,940 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [5712a30d] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 4f847082 >2012-08-06 11:55:57,989 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [5712a30d] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@cf22de24, log id: 4f847082 >2012-08-06 11:55:57,991 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [5712a30d] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = aab8ddd3-c8ba-48f7-81e0-aee057f98c74, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 204bbc5c-8a74-4d0f-946c-9037ef52a966, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 506eb2df >2012-08-06 11:55:57,992 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [5712a30d] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 11:55:57,993 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [5712a30d] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=aab8ddd3-c8ba-48f7-81e0-aee057f98c74 > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=204bbc5c-8a74-4d0f-946c-9037ef52a966 > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 11:55:58,190 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [5712a30d] FINISH, CreateSnapshotVDSCommand, return: 204bbc5c-8a74-4d0f-946c-9037ef52a966, log id: 506eb2df >2012-08-06 11:55:58,214 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) [5712a30d] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 10ef6062-3141-48a6-a778-c79f7a47154e >2012-08-06 11:55:58,215 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [5712a30d] EntityMultiAsyncTasks::AttachTask: Attaching task b3ec18d9-8f17-486d-ba72-d4d71a5bced1 to entity 10ef6062-3141-48a6-a778-c79f7a47154e. >2012-08-06 11:55:58,216 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-48) [5712a30d] Adding task b3ec18d9-8f17-486d-ba72-d4d71a5bced1 to DataBase >2012-08-06 11:55:58,283 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-48) [5712a30d] Adding task b3ec18d9-8f17-486d-ba72-d4d71a5bced1 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 11:55:58,492 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) [5712a30d] BaseAsyncTask::StartPollingTask: Starting to poll task b3ec18d9-8f17-486d-ba72-d4d71a5bced1. >2012-08-06 11:55:58,493 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [5712a30d] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 10ef6062-3141-48a6-a778-c79f7a47154e is AddVm (determined by task b3ec18d9-8f17-486d-ba72-d4d71a5bced1) >2012-08-06 11:55:58,506 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-48) [382718a5] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 11:55:58,614 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [4cae30da] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 2570e39e >2012-08-06 11:55:58,616 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [4cae30da] FINISH, IsValidVDSCommand, return: true, log id: 2570e39e >2012-08-06 11:55:58,721 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-48) [4cae30da] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:55:58,734 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [70b384c3] Lock Acquired to object EngineLock [exclusiveLocks= key: pool-7 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:55:58,767 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-26) Polling and updating Async Tasks: 7 tasks, 6 tasks to poll now >2012-08-06 11:55:58,793 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [70b384c3] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 370da7f7 >2012-08-06 11:55:58,794 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [70b384c3] FINISH, IsValidVDSCommand, return: true, log id: 370da7f7 >2012-08-06 11:55:58,797 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [70b384c3] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:55:58,802 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [70b384c3] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 172d54ef >2012-08-06 11:55:58,806 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [70b384c3] FINISH, IsValidVDSCommand, return: true, log id: 172d54ef >2012-08-06 11:55:58,817 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-26) SPMAsyncTask::PollTask: Polling task b3ec18d9-8f17-486d-ba72-d4d71a5bced1 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2012-08-06 11:55:58,818 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-26) SPMAsyncTask::PollTask: Polling task b683051b-a9ac-4427-a593-22559e2ce34d (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2012-08-06 11:55:58,819 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-26) SPMAsyncTask::PollTask: Polling task aea05448-9988-401b-851a-6fb9a08a11e7 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 11:55:58,820 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [70b384c3] MacPoolManager::allocateNewMac entered >2012-08-06 11:55:58,821 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [70b384c3] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:5a >2012-08-06 11:55:58,876 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-26) BaseAsyncTask::OnTaskEndSuccess: Task aea05448-9988-401b-851a-6fb9a08a11e7 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 11:55:58,877 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [70b384c3] Lock freed to object EngineLock [exclusiveLocks= key: pool-7 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:55:58,878 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [70b384c3] START, SetVmStatusVDSCommand(vmId = 66e09847-ee2c-4385-91d2-e7b698d53f85, status = ImageLocked), log id: 598b027 >2012-08-06 11:55:58,880 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-26) EntityAsyncTask::EndActionIfNecessary: All tasks of entity e047ae8c-befe-4805-bc8c-929bb3408fbe has ended -> executing EndAction >2012-08-06 11:55:58,881 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-26) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: e047ae8c-befe-4805-bc8c-929bb3408fbe): calling EndAction for action type AddVm. >2012-08-06 11:55:58,885 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 11:55:58,886 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-26) SPMAsyncTask::PollTask: Polling task eaf32b47-8f22-4dc9-aaed-dc2e6d178d55 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 11:55:58,888 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [70b384c3] FINISH, SetVmStatusVDSCommand, log id: 598b027 >2012-08-06 11:55:58,896 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-48) [226320fa] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 11:55:58,900 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [226320fa] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 61ecb508 >2012-08-06 11:55:58,944 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-26) BaseAsyncTask::OnTaskEndSuccess: Task eaf32b47-8f22-4dc9-aaed-dc2e6d178d55 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 11:55:58,960 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-26) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 has ended -> executing EndAction >2012-08-06 11:55:58,961 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-26) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4): calling EndAction for action type AddVm. >2012-08-06 11:55:58,962 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-26) SPMAsyncTask::PollTask: Polling task 36dc6693-4b53-4505-8277-aaac34127679 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 11:55:58,963 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 11:55:59,037 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [226320fa] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@cf22de24, log id: 61ecb508 >2012-08-06 11:55:59,036 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [600b8c9e] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 11:55:59,040 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-50) [3b439a6] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 11:55:59,042 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [3b439a6] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = defea5bf-fa7b-4b85-acb3-bab8d91c9966, imageId = 67b83e74-781d-4c05-a6a9-17125d15753f), log id: 45c1ac1e >2012-08-06 11:55:59,044 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [226320fa] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 5ddd1197-ad22-48fe-a444-b4f3247329e9, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 7750c0e3-d2a9-4713-8749-c47b0d1aac36, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 5cbff8ca >2012-08-06 11:55:59,047 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [226320fa] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 11:55:59,048 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [226320fa] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=5ddd1197-ad22-48fe-a444-b4f3247329e9 > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=7750c0e3-d2a9-4713-8749-c47b0d1aac36 > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 11:55:59,050 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-26) BaseAsyncTask::OnTaskEndSuccess: Task 36dc6693-4b53-4505-8277-aaac34127679 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 11:55:59,056 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-26) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3 has ended -> executing EndAction >2012-08-06 11:55:59,057 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-26) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3): calling EndAction for action type AddVm. >2012-08-06 11:55:59,060 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-47) [48ed62d0] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 11:55:59,060 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-47) [7747270b] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 11:55:59,064 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-47) [7747270b] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 39207fa9-2d8b-4c91-a8d6-79bc119b38dd, imageId = 1f61f361-5277-4e06-b61a-443dea553032), log id: 1011f50b >2012-08-06 11:55:59,067 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 11:55:59,072 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-26) SPMAsyncTask::PollTask: Polling task 79cc8a94-947c-4671-ae95-4e03cdf4e059 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 11:55:59,097 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-26) BaseAsyncTask::OnTaskEndSuccess: Task 79cc8a94-947c-4671-ae95-4e03cdf4e059 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 11:55:59,098 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-26) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 6a8ef0f6-c139-41d9-a814-60ca51daa5f4 has ended -> executing EndAction >2012-08-06 11:55:59,099 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-26) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 6a8ef0f6-c139-41d9-a814-60ca51daa5f4): calling EndAction for action type AddVm. >2012-08-06 11:55:59,106 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-46) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 11:55:59,110 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-26) Finished polling Tasks, will poll again in 10 seconds. >2012-08-06 11:55:59,141 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-49) [29baa020] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 11:55:59,142 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-49) [56ad8e84] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 11:55:59,158 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-49) [56ad8e84] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = c11fe8ad-261d-4b34-a034-e5772dc3305d, imageId = e7ddb179-c2d5-4a8d-ad54-1c7827aec960), log id: 5c9a2dfc >2012-08-06 11:55:59,204 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-46) [491c7a3f] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 11:55:59,205 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-46) [167f1eb0] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 11:55:59,214 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-46) [167f1eb0] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 3e3d72e9-e806-4e3d-810f-279907509728, imageId = 4b5d3e84-ae11-4ed4-808a-997d2f2a773b), log id: 10b08859 >2012-08-06 11:55:59,457 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [226320fa] FINISH, CreateSnapshotVDSCommand, return: 7750c0e3-d2a9-4713-8749-c47b0d1aac36, log id: 5cbff8ca >2012-08-06 11:55:59,509 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) [226320fa] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 66e09847-ee2c-4385-91d2-e7b698d53f85 >2012-08-06 11:55:59,510 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [226320fa] EntityMultiAsyncTasks::AttachTask: Attaching task 9be823df-a864-4833-a4e1-2fe213d161bb to entity 66e09847-ee2c-4385-91d2-e7b698d53f85. >2012-08-06 11:55:59,517 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-48) [226320fa] Adding task 9be823df-a864-4833-a4e1-2fe213d161bb to DataBase >2012-08-06 11:55:59,655 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-48) [226320fa] Adding task 9be823df-a864-4833-a4e1-2fe213d161bb (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 11:56:00,153 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) [226320fa] BaseAsyncTask::StartPollingTask: Starting to poll task 9be823df-a864-4833-a4e1-2fe213d161bb. >2012-08-06 11:56:00,153 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [226320fa] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 66e09847-ee2c-4385-91d2-e7b698d53f85 is AddVm (determined by task 9be823df-a864-4833-a4e1-2fe213d161bb) >2012-08-06 11:56:00,338 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-46) [167f1eb0] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@bc6bdc25, log id: 10b08859 >2012-08-06 11:56:00,357 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-48) [17d15909] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 11:56:00,447 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-49) [56ad8e84] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@d6910649, log id: 5c9a2dfc >2012-08-06 11:56:00,459 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-46) START, SetVmStatusVDSCommand(vmId = 6a8ef0f6-c139-41d9-a814-60ca51daa5f4, status = Down), log id: 68ec3927 >2012-08-06 11:56:00,487 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-46) FINISH, SetVmStatusVDSCommand, log id: 68ec3927 >2012-08-06 11:56:00,558 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-47) [7747270b] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@2200746b, log id: 1011f50b >2012-08-06 11:56:00,630 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [5244d885] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: ead3529 >2012-08-06 11:56:00,631 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [5244d885] FINISH, IsValidVDSCommand, return: true, log id: ead3529 >2012-08-06 11:56:00,658 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [3b439a6] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@fd07e3ea, log id: 45c1ac1e >2012-08-06 11:56:00,704 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-46) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 634b19ec >2012-08-06 11:56:00,708 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-48) [5244d885] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:56:00,733 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [804f748] Lock Acquired to object EngineLock [exclusiveLocks= key: pool-8 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:56:00,828 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-46) FINISH, UpdateVMVDSCommand, log id: 634b19ec >2012-08-06 11:56:00,892 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-46) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 11:56:00,893 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-46) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 11:56:00,907 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-49) START, SetVmStatusVDSCommand(vmId = 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3, status = Down), log id: 63b25412 >2012-08-06 11:56:00,914 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-49) FINISH, SetVmStatusVDSCommand, log id: 63b25412 >2012-08-06 11:56:00,944 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-46) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 79cc8a94-947c-4671-ae95-4e03cdf4e059 >2012-08-06 11:56:00,962 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-46) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 79cc8a94-947c-4671-ae95-4e03cdf4e059), log id: 457e220 >2012-08-06 11:56:00,996 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-46) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=79cc8a94-947c-4671-ae95-4e03cdf4e059), log id: 2cd75abf >2012-08-06 11:56:01,054 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-49) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 79d10dce >2012-08-06 11:56:01,077 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [804f748] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 269475f8 >2012-08-06 11:56:01,083 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [804f748] FINISH, IsValidVDSCommand, return: true, log id: 269475f8 >2012-08-06 11:56:01,085 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [804f748] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:56:01,089 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [804f748] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 384cefeb >2012-08-06 11:56:01,094 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-46) FINISH, HSMClearTaskVDSCommand, log id: 2cd75abf >2012-08-06 11:56:01,094 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-46) FINISH, SPMClearTaskVDSCommand, log id: 457e220 >2012-08-06 11:56:01,105 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [804f748] FINISH, IsValidVDSCommand, return: true, log id: 384cefeb >2012-08-06 11:56:01,111 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-46) BaseAsyncTask::RemoveTaskFromDB: Removed task 79cc8a94-947c-4671-ae95-4e03cdf4e059 from DataBase >2012-08-06 11:56:01,111 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-46) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 6a8ef0f6-c139-41d9-a814-60ca51daa5f4 >2012-08-06 11:56:01,126 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [804f748] MacPoolManager::allocateNewMac entered >2012-08-06 11:56:01,126 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [804f748] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:5f >2012-08-06 11:56:01,199 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-49) FINISH, UpdateVMVDSCommand, log id: 79d10dce >2012-08-06 11:56:01,254 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 11:56:01,254 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 11:56:01,270 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [804f748] Lock freed to object EngineLock [exclusiveLocks= key: pool-8 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:56:01,271 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [804f748] START, SetVmStatusVDSCommand(vmId = 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94, status = ImageLocked), log id: 46223a58 >2012-08-06 11:56:01,277 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [804f748] FINISH, SetVmStatusVDSCommand, log id: 46223a58 >2012-08-06 11:56:01,280 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-48) [1f116f79] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 11:56:01,288 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) START, SetVmStatusVDSCommand(vmId = 3c5452c9-a5e2-46af-90b5-b568da5dc3d4, status = Down), log id: 43dfe362 >2012-08-06 11:56:01,292 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) FINISH, SetVmStatusVDSCommand, log id: 43dfe362 >2012-08-06 11:56:01,298 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [1f116f79] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 2f97beca >2012-08-06 11:56:01,319 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-49) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 36dc6693-4b53-4505-8277-aaac34127679 >2012-08-06 11:56:01,320 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-49) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 36dc6693-4b53-4505-8277-aaac34127679), log id: 22cd002 >2012-08-06 11:56:01,385 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [1f116f79] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@cf22de24, log id: 2f97beca >2012-08-06 11:56:01,388 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-49) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=36dc6693-4b53-4505-8277-aaac34127679), log id: 599cd680 >2012-08-06 11:56:01,390 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [1f116f79] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 7104d1b5-968e-4035-973b-4c94cb7dba00, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = c308439a-56db-4d32-99a1-d4682da25929, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 400884ca >2012-08-06 11:56:01,409 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-47) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 6f460a9d >2012-08-06 11:56:01,531 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-49) FINISH, HSMClearTaskVDSCommand, log id: 599cd680 >2012-08-06 11:56:01,531 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-49) FINISH, SPMClearTaskVDSCommand, log id: 22cd002 >2012-08-06 11:56:01,560 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-49) BaseAsyncTask::RemoveTaskFromDB: Removed task 36dc6693-4b53-4505-8277-aaac34127679 from DataBase >2012-08-06 11:56:01,561 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3 >2012-08-06 11:56:01,667 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-47) FINISH, UpdateVMVDSCommand, log id: 6f460a9d >2012-08-06 11:56:01,668 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [1f116f79] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 11:56:01,669 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [1f116f79] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=7104d1b5-968e-4035-973b-4c94cb7dba00 > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=c308439a-56db-4d32-99a1-d4682da25929 > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 11:56:01,774 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 11:56:01,774 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 11:56:01,800 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) START, SetVmStatusVDSCommand(vmId = e047ae8c-befe-4805-bc8c-929bb3408fbe, status = Down), log id: 4ecc5b19 >2012-08-06 11:56:01,809 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) FINISH, SetVmStatusVDSCommand, log id: 4ecc5b19 >2012-08-06 11:56:01,847 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [1f116f79] FINISH, CreateSnapshotVDSCommand, return: c308439a-56db-4d32-99a1-d4682da25929, log id: 400884ca >2012-08-06 11:56:01,924 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-50) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 36757d3a >2012-08-06 11:56:01,955 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) SPMAsyncTask::ClearAsyncTask: Attempting to clear task eaf32b47-8f22-4dc9-aaed-dc2e6d178d55 >2012-08-06 11:56:01,955 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-47) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = eaf32b47-8f22-4dc9-aaed-dc2e6d178d55), log id: 4fd3ac21 >2012-08-06 11:56:01,965 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) [1f116f79] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94 >2012-08-06 11:56:01,966 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [1f116f79] EntityMultiAsyncTasks::AttachTask: Attaching task d79765bc-18cc-4f37-8700-e63672b9e784 to entity 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94. >2012-08-06 11:56:01,968 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-48) [1f116f79] Adding task d79765bc-18cc-4f37-8700-e63672b9e784 to DataBase >2012-08-06 11:56:02,006 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-50) FINISH, UpdateVMVDSCommand, log id: 36757d3a >2012-08-06 11:56:02,027 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-48) [1f116f79] Adding task d79765bc-18cc-4f37-8700-e63672b9e784 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 11:56:02,030 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-47) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=eaf32b47-8f22-4dc9-aaed-dc2e6d178d55), log id: 70deb3b3 >2012-08-06 11:56:02,064 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 11:56:02,065 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 11:56:02,091 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task aea05448-9988-401b-851a-6fb9a08a11e7 >2012-08-06 11:56:02,093 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-50) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = aea05448-9988-401b-851a-6fb9a08a11e7), log id: 4b6127a >2012-08-06 11:56:02,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-47) FINISH, HSMClearTaskVDSCommand, log id: 70deb3b3 >2012-08-06 11:56:02,106 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-47) FINISH, SPMClearTaskVDSCommand, log id: 4fd3ac21 >2012-08-06 11:56:02,117 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) BaseAsyncTask::RemoveTaskFromDB: Removed task eaf32b47-8f22-4dc9-aaed-dc2e6d178d55 from DataBase >2012-08-06 11:56:02,117 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 >2012-08-06 11:56:02,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-50) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=aea05448-9988-401b-851a-6fb9a08a11e7), log id: 595df06b >2012-08-06 11:56:02,226 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 595df06b >2012-08-06 11:56:02,226 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 4b6127a >2012-08-06 11:56:02,239 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task aea05448-9988-401b-851a-6fb9a08a11e7 from DataBase >2012-08-06 11:56:02,239 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity e047ae8c-befe-4805-bc8c-929bb3408fbe >2012-08-06 11:56:02,456 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) [1f116f79] BaseAsyncTask::StartPollingTask: Starting to poll task d79765bc-18cc-4f37-8700-e63672b9e784. >2012-08-06 11:56:02,457 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [1f116f79] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94 is AddVm (determined by task d79765bc-18cc-4f37-8700-e63672b9e784) >2012-08-06 11:56:02,477 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-48) [74f619f4] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 11:56:02,595 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [4235cd29] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 70dfa137 >2012-08-06 11:56:02,597 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [4235cd29] FINISH, IsValidVDSCommand, return: true, log id: 70dfa137 >2012-08-06 11:56:02,658 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-48) [4235cd29] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:56:02,673 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [274aac89] Lock Acquired to object EngineLock [exclusiveLocks= key: pool-9 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:56:02,727 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [274aac89] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6501467d >2012-08-06 11:56:02,729 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [274aac89] FINISH, IsValidVDSCommand, return: true, log id: 6501467d >2012-08-06 11:56:02,730 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [274aac89] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:56:02,732 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [274aac89] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 5d1663d5 >2012-08-06 11:56:02,737 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [274aac89] FINISH, IsValidVDSCommand, return: true, log id: 5d1663d5 >2012-08-06 11:56:02,753 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [274aac89] MacPoolManager::allocateNewMac entered >2012-08-06 11:56:02,753 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [274aac89] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:5d >2012-08-06 11:56:02,782 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [274aac89] Lock freed to object EngineLock [exclusiveLocks= key: pool-9 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:56:02,784 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [274aac89] START, SetVmStatusVDSCommand(vmId = c26afa24-84a3-4a85-939b-c8b0b293a8e9, status = ImageLocked), log id: 150cad38 >2012-08-06 11:56:02,791 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [274aac89] FINISH, SetVmStatusVDSCommand, log id: 150cad38 >2012-08-06 11:56:02,792 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-48) [277948c] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 11:56:02,798 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [277948c] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 1824b483 >2012-08-06 11:56:02,861 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [277948c] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@cf22de24, log id: 1824b483 >2012-08-06 11:56:02,864 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [277948c] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 2cb1a185-1403-4a6e-a51b-378a096de43a, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 67bb3b1b-1310-4983-8213-4f03c6f0807f, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 54cabd5e >2012-08-06 11:56:02,866 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [277948c] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 11:56:02,866 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [277948c] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=2cb1a185-1403-4a6e-a51b-378a096de43a > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=67bb3b1b-1310-4983-8213-4f03c6f0807f > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 11:56:03,210 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [277948c] FINISH, CreateSnapshotVDSCommand, return: 67bb3b1b-1310-4983-8213-4f03c6f0807f, log id: 54cabd5e >2012-08-06 11:56:03,246 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) [277948c] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity c26afa24-84a3-4a85-939b-c8b0b293a8e9 >2012-08-06 11:56:03,247 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [277948c] EntityMultiAsyncTasks::AttachTask: Attaching task e559d483-1ea0-44c4-8ac3-4cf8c51ed4d6 to entity c26afa24-84a3-4a85-939b-c8b0b293a8e9. >2012-08-06 11:56:03,248 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-48) [277948c] Adding task e559d483-1ea0-44c4-8ac3-4cf8c51ed4d6 to DataBase >2012-08-06 11:56:03,305 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-48) [277948c] Adding task e559d483-1ea0-44c4-8ac3-4cf8c51ed4d6 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 11:56:03,502 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) [277948c] BaseAsyncTask::StartPollingTask: Starting to poll task e559d483-1ea0-44c4-8ac3-4cf8c51ed4d6. >2012-08-06 11:56:03,502 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [277948c] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity c26afa24-84a3-4a85-939b-c8b0b293a8e9 is AddVm (determined by task e559d483-1ea0-44c4-8ac3-4cf8c51ed4d6) >2012-08-06 11:56:03,513 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-48) [5e4d372a] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 11:56:03,594 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [634261c0] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 3272c5e1 >2012-08-06 11:56:03,595 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [634261c0] FINISH, IsValidVDSCommand, return: true, log id: 3272c5e1 >2012-08-06 11:56:03,653 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-48) [634261c0] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:56:03,667 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [2dc4b97a] Lock Acquired to object EngineLock [exclusiveLocks= key: pool-10 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:56:03,705 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [2dc4b97a] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4d9dfedd >2012-08-06 11:56:03,706 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [2dc4b97a] FINISH, IsValidVDSCommand, return: true, log id: 4d9dfedd >2012-08-06 11:56:03,708 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [2dc4b97a] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:56:03,710 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [2dc4b97a] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 36e4ba78 >2012-08-06 11:56:03,712 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [2dc4b97a] FINISH, IsValidVDSCommand, return: true, log id: 36e4ba78 >2012-08-06 11:56:03,728 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [2dc4b97a] MacPoolManager::allocateNewMac entered >2012-08-06 11:56:03,729 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [2dc4b97a] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:5e >2012-08-06 11:56:03,758 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [2dc4b97a] Lock freed to object EngineLock [exclusiveLocks= key: pool-10 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:56:03,759 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [2dc4b97a] START, SetVmStatusVDSCommand(vmId = 458adebd-ebe5-46f6-98a5-3359ab42f11b, status = ImageLocked), log id: 99ec035 >2012-08-06 11:56:03,765 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [2dc4b97a] FINISH, SetVmStatusVDSCommand, log id: 99ec035 >2012-08-06 11:56:03,766 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-48) [39944ce4] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 11:56:03,768 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [39944ce4] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 32f0cc07 >2012-08-06 11:56:03,827 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [39944ce4] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@cf22de24, log id: 32f0cc07 >2012-08-06 11:56:03,830 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [39944ce4] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0fcdc02a-488a-4750-8eb4-a3c0aa5e5dd6, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = b0df20d1-c2d2-48d0-8807-cbd150b07136, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 34e087b9 >2012-08-06 11:56:03,832 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [39944ce4] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 11:56:03,833 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [39944ce4] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=0fcdc02a-488a-4750-8eb4-a3c0aa5e5dd6 > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=b0df20d1-c2d2-48d0-8807-cbd150b07136 > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 11:56:04,203 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [39944ce4] FINISH, CreateSnapshotVDSCommand, return: b0df20d1-c2d2-48d0-8807-cbd150b07136, log id: 34e087b9 >2012-08-06 11:56:04,229 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) [39944ce4] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 458adebd-ebe5-46f6-98a5-3359ab42f11b >2012-08-06 11:56:04,229 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [39944ce4] EntityMultiAsyncTasks::AttachTask: Attaching task c0ed5faa-0378-4837-a0a2-f64ffac1cd0e to entity 458adebd-ebe5-46f6-98a5-3359ab42f11b. >2012-08-06 11:56:04,231 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-48) [39944ce4] Adding task c0ed5faa-0378-4837-a0a2-f64ffac1cd0e to DataBase >2012-08-06 11:56:04,279 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-48) [39944ce4] Adding task c0ed5faa-0378-4837-a0a2-f64ffac1cd0e (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 11:56:04,468 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) [39944ce4] BaseAsyncTask::StartPollingTask: Starting to poll task c0ed5faa-0378-4837-a0a2-f64ffac1cd0e. >2012-08-06 11:56:04,469 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [39944ce4] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 458adebd-ebe5-46f6-98a5-3359ab42f11b is AddVm (determined by task c0ed5faa-0378-4837-a0a2-f64ffac1cd0e) >2012-08-06 11:56:04,480 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-48) [7eaf5dd6] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 11:56:04,572 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [10bb4f26] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1745a785 >2012-08-06 11:56:04,574 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [10bb4f26] FINISH, IsValidVDSCommand, return: true, log id: 1745a785 >2012-08-06 11:56:04,675 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-48) [10bb4f26] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:56:04,688 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [524704c5] Lock Acquired to object EngineLock [exclusiveLocks= key: pool-11 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:56:04,814 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [524704c5] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6e1ab48b >2012-08-06 11:56:04,816 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [524704c5] FINISH, IsValidVDSCommand, return: true, log id: 6e1ab48b >2012-08-06 11:56:04,818 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [524704c5] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:56:04,822 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [524704c5] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 439637f >2012-08-06 11:56:04,824 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [524704c5] FINISH, IsValidVDSCommand, return: true, log id: 439637f >2012-08-06 11:56:04,834 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [524704c5] MacPoolManager::allocateNewMac entered >2012-08-06 11:56:04,834 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [524704c5] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:5b >2012-08-06 11:56:05,029 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [524704c5] Lock freed to object EngineLock [exclusiveLocks= key: pool-11 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:56:05,030 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [524704c5] START, SetVmStatusVDSCommand(vmId = a6c1ef37-5de7-403f-aecd-0185a55c3046, status = ImageLocked), log id: 7a930bab >2012-08-06 11:56:05,038 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [524704c5] FINISH, SetVmStatusVDSCommand, log id: 7a930bab >2012-08-06 11:56:05,047 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-48) [10e26621] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 11:56:05,050 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [10e26621] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 191cd251 >2012-08-06 11:56:05,152 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [10e26621] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@cf22de24, log id: 191cd251 >2012-08-06 11:56:05,156 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [10e26621] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 102250e3-631d-4789-8be8-bdd53b4cf9d0, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 7836c7d1-b827-4be0-81f5-85e670f1d5b9, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 35fefa2d >2012-08-06 11:56:05,158 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [10e26621] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 11:56:05,158 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [10e26621] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=102250e3-631d-4789-8be8-bdd53b4cf9d0 > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=7836c7d1-b827-4be0-81f5-85e670f1d5b9 > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 11:56:05,377 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [10e26621] FINISH, CreateSnapshotVDSCommand, return: 7836c7d1-b827-4be0-81f5-85e670f1d5b9, log id: 35fefa2d >2012-08-06 11:56:05,395 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) [10e26621] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity a6c1ef37-5de7-403f-aecd-0185a55c3046 >2012-08-06 11:56:05,396 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [10e26621] EntityMultiAsyncTasks::AttachTask: Attaching task f72e163a-0ee0-4665-a69e-55d926dfb324 to entity a6c1ef37-5de7-403f-aecd-0185a55c3046. >2012-08-06 11:56:05,397 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-48) [10e26621] Adding task f72e163a-0ee0-4665-a69e-55d926dfb324 to DataBase >2012-08-06 11:56:05,444 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-48) [10e26621] Adding task f72e163a-0ee0-4665-a69e-55d926dfb324 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 11:56:05,614 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) [10e26621] BaseAsyncTask::StartPollingTask: Starting to poll task f72e163a-0ee0-4665-a69e-55d926dfb324. >2012-08-06 11:56:05,615 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [10e26621] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity a6c1ef37-5de7-403f-aecd-0185a55c3046 is AddVm (determined by task f72e163a-0ee0-4665-a69e-55d926dfb324) >2012-08-06 11:56:05,626 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-48) [6858eb79] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 11:56:05,783 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [68df9209] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 124dd331 >2012-08-06 11:56:05,785 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [68df9209] FINISH, IsValidVDSCommand, return: true, log id: 124dd331 >2012-08-06 11:56:05,874 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-48) [68df9209] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:56:05,885 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [619e5a03] Lock Acquired to object EngineLock [exclusiveLocks= key: pool-12 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:56:05,908 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [619e5a03] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6081bfb1 >2012-08-06 11:56:05,909 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [619e5a03] FINISH, IsValidVDSCommand, return: true, log id: 6081bfb1 >2012-08-06 11:56:05,911 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [619e5a03] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:56:05,913 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [619e5a03] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 56139dd3 >2012-08-06 11:56:05,914 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [619e5a03] FINISH, IsValidVDSCommand, return: true, log id: 56139dd3 >2012-08-06 11:56:05,918 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [619e5a03] MacPoolManager::allocateNewMac entered >2012-08-06 11:56:05,919 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [619e5a03] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:5c >2012-08-06 11:56:05,942 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [619e5a03] Lock freed to object EngineLock [exclusiveLocks= key: pool-12 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:56:05,942 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [619e5a03] START, SetVmStatusVDSCommand(vmId = ad77ef63-994a-4f05-ae14-9488e891a059, status = ImageLocked), log id: 5dbd80d7 >2012-08-06 11:56:05,945 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [619e5a03] FINISH, SetVmStatusVDSCommand, log id: 5dbd80d7 >2012-08-06 11:56:05,947 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-48) [38b1ab8b] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 11:56:05,950 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [38b1ab8b] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 22727fdd >2012-08-06 11:56:05,997 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [38b1ab8b] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@cf22de24, log id: 22727fdd >2012-08-06 11:56:06,000 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [38b1ab8b] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = e4c5a274-d1b0-4966-a56f-a939cccb5018, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = cafb8631-e37b-408b-b996-bfd0f47a0a70, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 6a2d33b7 >2012-08-06 11:56:06,001 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [38b1ab8b] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 11:56:06,002 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [38b1ab8b] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=e4c5a274-d1b0-4966-a56f-a939cccb5018 > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=cafb8631-e37b-408b-b996-bfd0f47a0a70 > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 11:56:06,383 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [38b1ab8b] FINISH, CreateSnapshotVDSCommand, return: cafb8631-e37b-408b-b996-bfd0f47a0a70, log id: 6a2d33b7 >2012-08-06 11:56:06,410 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) [38b1ab8b] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity ad77ef63-994a-4f05-ae14-9488e891a059 >2012-08-06 11:56:06,412 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [38b1ab8b] EntityMultiAsyncTasks::AttachTask: Attaching task 2eff1a48-34f0-4aef-a7d7-3eb1638c7a7e to entity ad77ef63-994a-4f05-ae14-9488e891a059. >2012-08-06 11:56:06,414 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-48) [38b1ab8b] Adding task 2eff1a48-34f0-4aef-a7d7-3eb1638c7a7e to DataBase >2012-08-06 11:56:06,530 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-48) [38b1ab8b] Adding task 2eff1a48-34f0-4aef-a7d7-3eb1638c7a7e (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 11:56:06,724 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) [38b1ab8b] BaseAsyncTask::StartPollingTask: Starting to poll task 2eff1a48-34f0-4aef-a7d7-3eb1638c7a7e. >2012-08-06 11:56:06,725 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [38b1ab8b] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity ad77ef63-994a-4f05-ae14-9488e891a059 is AddVm (determined by task 2eff1a48-34f0-4aef-a7d7-3eb1638c7a7e) >2012-08-06 11:56:06,736 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-48) [43be703] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 11:56:06,826 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [4aad9ff1] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 517522a6 >2012-08-06 11:56:06,828 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [4aad9ff1] FINISH, IsValidVDSCommand, return: true, log id: 517522a6 >2012-08-06 11:56:06,904 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-48) [4aad9ff1] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:56:06,920 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [1dfa8c4a] Lock Acquired to object EngineLock [exclusiveLocks= key: pool-13 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:56:06,946 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [1dfa8c4a] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 60d3302b >2012-08-06 11:56:06,947 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [1dfa8c4a] FINISH, IsValidVDSCommand, return: true, log id: 60d3302b >2012-08-06 11:56:06,950 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [1dfa8c4a] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:56:06,954 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [1dfa8c4a] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 65d211b2 >2012-08-06 11:56:06,956 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [1dfa8c4a] FINISH, IsValidVDSCommand, return: true, log id: 65d211b2 >2012-08-06 11:56:06,963 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [1dfa8c4a] MacPoolManager::allocateNewMac entered >2012-08-06 11:56:06,964 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [1dfa8c4a] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:72 >2012-08-06 11:56:06,993 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [1dfa8c4a] Lock freed to object EngineLock [exclusiveLocks= key: pool-13 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:56:06,994 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [1dfa8c4a] START, SetVmStatusVDSCommand(vmId = de370719-d4d0-4299-93d6-2fc4a274aa28, status = ImageLocked), log id: 496128d1 >2012-08-06 11:56:07,001 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [1dfa8c4a] FINISH, SetVmStatusVDSCommand, log id: 496128d1 >2012-08-06 11:56:07,003 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-48) [646644d0] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 11:56:07,009 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [646644d0] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 2d3e96c3 >2012-08-06 11:56:07,082 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [646644d0] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@cf22de24, log id: 2d3e96c3 >2012-08-06 11:56:07,085 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [646644d0] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0dc3326b-6e58-4117-8d83-77ab85529263, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 5d9440e0-78c8-494c-99f1-81b9bca8a8ac, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 6a5f4488 >2012-08-06 11:56:07,087 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [646644d0] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 11:56:07,088 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [646644d0] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=0dc3326b-6e58-4117-8d83-77ab85529263 > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=5d9440e0-78c8-494c-99f1-81b9bca8a8ac > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 11:56:07,488 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [646644d0] FINISH, CreateSnapshotVDSCommand, return: 5d9440e0-78c8-494c-99f1-81b9bca8a8ac, log id: 6a5f4488 >2012-08-06 11:56:07,507 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) [646644d0] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity de370719-d4d0-4299-93d6-2fc4a274aa28 >2012-08-06 11:56:07,508 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [646644d0] EntityMultiAsyncTasks::AttachTask: Attaching task bdbdaefa-f354-4436-a836-b0d5e7b37eba to entity de370719-d4d0-4299-93d6-2fc4a274aa28. >2012-08-06 11:56:07,509 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-48) [646644d0] Adding task bdbdaefa-f354-4436-a836-b0d5e7b37eba to DataBase >2012-08-06 11:56:07,562 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-48) [646644d0] Adding task bdbdaefa-f354-4436-a836-b0d5e7b37eba (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 11:56:07,702 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) [646644d0] BaseAsyncTask::StartPollingTask: Starting to poll task bdbdaefa-f354-4436-a836-b0d5e7b37eba. >2012-08-06 11:56:07,703 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [646644d0] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity de370719-d4d0-4299-93d6-2fc4a274aa28 is AddVm (determined by task bdbdaefa-f354-4436-a836-b0d5e7b37eba) >2012-08-06 11:56:07,713 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-48) [6e9a62dc] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 11:56:07,849 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [2e9b72bb] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 7db4ab54 >2012-08-06 11:56:07,852 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [2e9b72bb] FINISH, IsValidVDSCommand, return: true, log id: 7db4ab54 >2012-08-06 11:56:07,919 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-48) [2e9b72bb] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:56:07,928 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [583b4ac9] Lock Acquired to object EngineLock [exclusiveLocks= key: pool-14 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:56:07,955 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [583b4ac9] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 278a8d49 >2012-08-06 11:56:07,956 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [583b4ac9] FINISH, IsValidVDSCommand, return: true, log id: 278a8d49 >2012-08-06 11:56:07,958 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [583b4ac9] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:56:07,959 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [583b4ac9] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6a974061 >2012-08-06 11:56:07,961 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [583b4ac9] FINISH, IsValidVDSCommand, return: true, log id: 6a974061 >2012-08-06 11:56:07,965 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [583b4ac9] MacPoolManager::allocateNewMac entered >2012-08-06 11:56:07,965 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [583b4ac9] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:73 >2012-08-06 11:56:07,985 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [583b4ac9] Lock freed to object EngineLock [exclusiveLocks= key: pool-14 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:56:07,986 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [583b4ac9] START, SetVmStatusVDSCommand(vmId = 3ee28762-5b38-409a-8e34-aebd1ed491f6, status = ImageLocked), log id: b509fd5 >2012-08-06 11:56:07,988 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [583b4ac9] FINISH, SetVmStatusVDSCommand, log id: b509fd5 >2012-08-06 11:56:07,990 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-48) [271c6110] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 11:56:07,992 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [271c6110] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 4efccce >2012-08-06 11:56:08,044 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [271c6110] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@cf22de24, log id: 4efccce >2012-08-06 11:56:08,046 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [271c6110] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 7f7d0278-869e-4ed6-8277-6df2825a57d2, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 0ce57ab9-0e61-4891-8137-77587ab0f124, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 3fc06565 >2012-08-06 11:56:08,048 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [271c6110] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 11:56:08,048 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [271c6110] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=7f7d0278-869e-4ed6-8277-6df2825a57d2 > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=0ce57ab9-0e61-4891-8137-77587ab0f124 > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 11:56:08,587 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [271c6110] FINISH, CreateSnapshotVDSCommand, return: 0ce57ab9-0e61-4891-8137-77587ab0f124, log id: 3fc06565 >2012-08-06 11:56:08,614 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) [271c6110] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 3ee28762-5b38-409a-8e34-aebd1ed491f6 >2012-08-06 11:56:08,615 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [271c6110] EntityMultiAsyncTasks::AttachTask: Attaching task 1695531c-f7f2-43e5-95d1-7e772e89c106 to entity 3ee28762-5b38-409a-8e34-aebd1ed491f6. >2012-08-06 11:56:08,616 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-48) [271c6110] Adding task 1695531c-f7f2-43e5-95d1-7e772e89c106 to DataBase >2012-08-06 11:56:08,670 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-48) [271c6110] Adding task 1695531c-f7f2-43e5-95d1-7e772e89c106 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 11:56:08,811 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) [271c6110] BaseAsyncTask::StartPollingTask: Starting to poll task 1695531c-f7f2-43e5-95d1-7e772e89c106. >2012-08-06 11:56:08,812 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [271c6110] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 3ee28762-5b38-409a-8e34-aebd1ed491f6 is AddVm (determined by task 1695531c-f7f2-43e5-95d1-7e772e89c106) >2012-08-06 11:56:08,824 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-48) [74b7e91f] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 11:56:08,925 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [6521d571] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 616acd38 >2012-08-06 11:56:08,927 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [6521d571] FINISH, IsValidVDSCommand, return: true, log id: 616acd38 >2012-08-06 11:56:08,991 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-48) [6521d571] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:56:09,004 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [12e8e861] Lock Acquired to object EngineLock [exclusiveLocks= key: pool-15 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:56:09,027 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [12e8e861] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 43d43317 >2012-08-06 11:56:09,029 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [12e8e861] FINISH, IsValidVDSCommand, return: true, log id: 43d43317 >2012-08-06 11:56:09,031 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [12e8e861] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 11:56:09,032 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [12e8e861] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 2951328c >2012-08-06 11:56:09,036 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) [12e8e861] FINISH, IsValidVDSCommand, return: true, log id: 2951328c >2012-08-06 11:56:09,048 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [12e8e861] MacPoolManager::allocateNewMac entered >2012-08-06 11:56:09,048 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-48) [12e8e861] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:70 >2012-08-06 11:56:09,083 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [12e8e861] Lock freed to object EngineLock [exclusiveLocks= key: pool-15 value: VM_NAME >, sharedLocks= ] >2012-08-06 11:56:09,084 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [12e8e861] START, SetVmStatusVDSCommand(vmId = 95b9258b-9b92-4b12-93fa-b5056b9176d9, status = ImageLocked), log id: 48bd6971 >2012-08-06 11:56:09,129 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-39) Polling and updating Async Tasks: 15 tasks, 10 tasks to poll now >2012-08-06 11:56:09,139 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [12e8e861] FINISH, SetVmStatusVDSCommand, log id: 48bd6971 >2012-08-06 11:56:09,141 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-48) [79b861ec] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 11:56:09,143 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [79b861ec] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 713974c0 >2012-08-06 11:56:09,209 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-39) SPMAsyncTask::PollTask: Polling task b3ec18d9-8f17-486d-ba72-d4d71a5bced1 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 11:56:09,270 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [79b861ec] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@cf22de24, log id: 713974c0 >2012-08-06 11:56:09,273 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [79b861ec] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 530b2043-4d0e-433d-9e43-562abe9fcf93, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = c5ae4b5c-e31c-40b9-ade3-5ddcb15230a6, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 954a36c >2012-08-06 11:56:09,275 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [79b861ec] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 11:56:09,276 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [79b861ec] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=530b2043-4d0e-433d-9e43-562abe9fcf93 > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=c5ae4b5c-e31c-40b9-ade3-5ddcb15230a6 > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 11:56:09,298 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-39) BaseAsyncTask::OnTaskEndSuccess: Task b3ec18d9-8f17-486d-ba72-d4d71a5bced1 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 11:56:09,299 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-39) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 10ef6062-3141-48a6-a778-c79f7a47154e has ended -> executing EndAction >2012-08-06 11:56:09,300 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-39) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 10ef6062-3141-48a6-a778-c79f7a47154e): calling EndAction for action type AddVm. >2012-08-06 11:56:09,307 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-39) SPMAsyncTask::PollTask: Polling task b683051b-a9ac-4427-a593-22559e2ce34d (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 11:56:09,310 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 11:56:09,327 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-39) BaseAsyncTask::OnTaskEndSuccess: Task b683051b-a9ac-4427-a593-22559e2ce34d (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 11:56:09,328 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-39) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 4dfd7e9a-0245-403d-8fe6-f415f61121af has ended -> executing EndAction >2012-08-06 11:56:09,329 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-39) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 4dfd7e9a-0245-403d-8fe6-f415f61121af): calling EndAction for action type AddVm. >2012-08-06 11:56:09,330 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-34) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 11:56:09,337 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-39) SPMAsyncTask::PollTask: Polling task f72e163a-0ee0-4665-a69e-55d926dfb324 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 11:56:09,391 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-47) [35fc50db] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 11:56:09,392 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-47) [5712a30d] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 11:56:09,402 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-47) [5712a30d] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = aab8ddd3-c8ba-48f7-81e0-aee057f98c74, imageId = 204bbc5c-8a74-4d0f-946c-9037ef52a966), log id: 71a3902 >2012-08-06 11:56:09,425 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-39) BaseAsyncTask::OnTaskEndSuccess: Task f72e163a-0ee0-4665-a69e-55d926dfb324 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 11:56:09,428 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-39) EntityAsyncTask::EndActionIfNecessary: All tasks of entity a6c1ef37-5de7-403f-aecd-0185a55c3046 has ended -> executing EndAction >2012-08-06 11:56:09,429 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-39) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: a6c1ef37-5de7-403f-aecd-0185a55c3046): calling EndAction for action type AddVm. >2012-08-06 11:56:09,433 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 11:56:09,443 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-39) SPMAsyncTask::PollTask: Polling task 9be823df-a864-4833-a4e1-2fe213d161bb (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 11:56:09,449 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-34) [85fe0d1] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 11:56:09,450 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-34) [6cfe3a1b] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 11:56:09,464 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-34) [6cfe3a1b] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 7e1d2bb1-9a49-4c3a-914d-8604d49f9f5f, imageId = 9526aacf-a526-4dc6-a2f0-625ec7dfef12), log id: 3924587f >2012-08-06 11:56:09,474 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-39) BaseAsyncTask::OnTaskEndSuccess: Task 9be823df-a864-4833-a4e1-2fe213d161bb (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 11:56:09,489 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-39) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 66e09847-ee2c-4385-91d2-e7b698d53f85 has ended -> executing EndAction >2012-08-06 11:56:09,490 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-39) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 66e09847-ee2c-4385-91d2-e7b698d53f85): calling EndAction for action type AddVm. >2012-08-06 11:56:09,493 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-46) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 11:56:09,494 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-39) SPMAsyncTask::PollTask: Polling task d79765bc-18cc-4f37-8700-e63672b9e784 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 11:56:09,506 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-49) [524704c5] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 11:56:09,507 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-49) [10e26621] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 11:56:09,524 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-49) [10e26621] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 102250e3-631d-4789-8be8-bdd53b4cf9d0, imageId = 7836c7d1-b827-4be0-81f5-85e670f1d5b9), log id: a8e86b6 >2012-08-06 11:56:09,527 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-39) BaseAsyncTask::OnTaskEndSuccess: Task d79765bc-18cc-4f37-8700-e63672b9e784 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 11:56:09,578 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-39) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94 has ended -> executing EndAction >2012-08-06 11:56:09,579 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-39) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94): calling EndAction for action type AddVm. >2012-08-06 11:56:09,580 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-45) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 11:56:09,585 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-39) SPMAsyncTask::PollTask: Polling task bdbdaefa-f354-4436-a836-b0d5e7b37eba (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2012-08-06 11:56:09,586 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-39) SPMAsyncTask::PollTask: Polling task c0ed5faa-0378-4837-a0a2-f64ffac1cd0e (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 11:56:09,626 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-46) [70b384c3] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 11:56:09,629 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-46) [226320fa] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 11:56:09,643 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-46) [226320fa] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 5ddd1197-ad22-48fe-a444-b4f3247329e9, imageId = 7750c0e3-d2a9-4713-8749-c47b0d1aac36), log id: 192d8873 >2012-08-06 11:56:09,656 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-39) BaseAsyncTask::OnTaskEndSuccess: Task c0ed5faa-0378-4837-a0a2-f64ffac1cd0e (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 11:56:09,658 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-39) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 458adebd-ebe5-46f6-98a5-3359ab42f11b has ended -> executing EndAction >2012-08-06 11:56:09,658 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-39) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 458adebd-ebe5-46f6-98a5-3359ab42f11b): calling EndAction for action type AddVm. >2012-08-06 11:56:09,681 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 11:56:09,689 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-39) SPMAsyncTask::PollTask: Polling task 2eff1a48-34f0-4aef-a7d7-3eb1638c7a7e (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 11:56:09,775 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-48) [79b861ec] FINISH, CreateSnapshotVDSCommand, return: c5ae4b5c-e31c-40b9-ade3-5ddcb15230a6, log id: 954a36c >2012-08-06 11:56:09,852 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-39) BaseAsyncTask::OnTaskEndSuccess: Task 2eff1a48-34f0-4aef-a7d7-3eb1638c7a7e (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 11:56:09,855 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-39) EntityAsyncTask::EndActionIfNecessary: All tasks of entity ad77ef63-994a-4f05-ae14-9488e891a059 has ended -> executing EndAction >2012-08-06 11:56:09,856 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-39) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: ad77ef63-994a-4f05-ae14-9488e891a059): calling EndAction for action type AddVm. >2012-08-06 11:56:09,856 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-43) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 11:56:09,866 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-39) SPMAsyncTask::PollTask: Polling task 1695531c-f7f2-43e5-95d1-7e772e89c106 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2012-08-06 11:56:09,867 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-39) SPMAsyncTask::PollTask: Polling task e559d483-1ea0-44c4-8ac3-4cf8c51ed4d6 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 11:56:09,889 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) [79b861ec] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 95b9258b-9b92-4b12-93fa-b5056b9176d9 >2012-08-06 11:56:09,890 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [79b861ec] EntityMultiAsyncTasks::AttachTask: Attaching task e90defa7-0a32-493a-9f32-44698d9e1bd0 to entity 95b9258b-9b92-4b12-93fa-b5056b9176d9. >2012-08-06 11:56:09,897 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-46) [226320fa] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@7380425a, log id: 192d8873 >2012-08-06 11:56:09,934 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-48) [79b861ec] Adding task e90defa7-0a32-493a-9f32-44698d9e1bd0 to DataBase >2012-08-06 11:56:09,949 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-44) [2dc4b97a] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 11:56:09,950 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-44) [39944ce4] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 11:56:09,977 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-44) [39944ce4] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0fcdc02a-488a-4750-8eb4-a3c0aa5e5dd6, imageId = b0df20d1-c2d2-48d0-8807-cbd150b07136), log id: 29fee2a5 >2012-08-06 11:56:10,024 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-39) BaseAsyncTask::OnTaskEndSuccess: Task e559d483-1ea0-44c4-8ac3-4cf8c51ed4d6 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 11:56:10,074 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-39) EntityAsyncTask::EndActionIfNecessary: All tasks of entity c26afa24-84a3-4a85-939b-c8b0b293a8e9 has ended -> executing EndAction >2012-08-06 11:56:10,075 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-39) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: c26afa24-84a3-4a85-939b-c8b0b293a8e9): calling EndAction for action type AddVm. >2012-08-06 11:56:10,084 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-39) Finished polling Tasks, will poll again in 10 seconds. >2012-08-06 11:56:10,103 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 11:56:10,107 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-49) [10e26621] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@bb134787, log id: a8e86b6 >2012-08-06 11:56:10,195 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-48) [79b861ec] Adding task e90defa7-0a32-493a-9f32-44698d9e1bd0 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 11:56:10,271 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-34) [6cfe3a1b] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@6c81dc3f, log id: 3924587f >2012-08-06 11:56:10,274 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-46) START, SetVmStatusVDSCommand(vmId = 66e09847-ee2c-4385-91d2-e7b698d53f85, status = Down), log id: 24cd5c57 >2012-08-06 11:56:10,314 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-45) [804f748] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 11:56:10,315 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-45) [1f116f79] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 11:56:10,369 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-45) [1f116f79] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 7104d1b5-968e-4035-973b-4c94cb7dba00, imageId = c308439a-56db-4d32-99a1-d4682da25929), log id: 5c0462c4 >2012-08-06 11:56:10,382 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-46) FINISH, SetVmStatusVDSCommand, log id: 24cd5c57 >2012-08-06 11:56:10,423 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-47) [5712a30d] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@c821925c, log id: 71a3902 >2012-08-06 11:56:10,480 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-46) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 28cb7586 >2012-08-06 11:56:10,546 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-42) [274aac89] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 11:56:10,547 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-42) [277948c] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 11:56:10,548 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-45) [1f116f79] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@5e7c1827, log id: 5c0462c4 >2012-08-06 11:56:10,566 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-42) [277948c] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 2cb1a185-1403-4a6e-a51b-378a096de43a, imageId = 67bb3b1b-1310-4983-8213-4f03c6f0807f), log id: 4921137d >2012-08-06 11:56:10,828 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-43) [619e5a03] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 11:56:10,829 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-43) [38b1ab8b] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 11:56:10,853 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-43) [38b1ab8b] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = e4c5a274-d1b0-4966-a56f-a939cccb5018, imageId = cafb8631-e37b-408b-b996-bfd0f47a0a70), log id: 4942a203 >2012-08-06 11:56:11,904 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-44) [39944ce4] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@874390fc, log id: 29fee2a5 >2012-08-06 11:56:11,983 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-43) [38b1ab8b] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@965e82f7, log id: 4942a203 >2012-08-06 11:56:12,043 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-42) [277948c] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@25d0b2e9, log id: 4921137d >2012-08-06 11:56:12,141 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-46) FINISH, UpdateVMVDSCommand, log id: 28cb7586 >2012-08-06 11:56:12,214 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-49) START, SetVmStatusVDSCommand(vmId = a6c1ef37-5de7-403f-aecd-0185a55c3046, status = Down), log id: e0f5c2a >2012-08-06 11:56:12,218 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-46) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 11:56:12,218 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-46) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 11:56:12,228 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-49) FINISH, SetVmStatusVDSCommand, log id: e0f5c2a >2012-08-06 11:56:12,289 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-46) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 9be823df-a864-4833-a4e1-2fe213d161bb >2012-08-06 11:56:12,290 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-46) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 9be823df-a864-4833-a4e1-2fe213d161bb), log id: 2fc70727 >2012-08-06 11:56:12,291 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-49) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 33a6a9f2 >2012-08-06 11:56:12,381 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-49) FINISH, UpdateVMVDSCommand, log id: 33a6a9f2 >2012-08-06 11:56:12,390 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-46) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=9be823df-a864-4833-a4e1-2fe213d161bb), log id: 70bae4e >2012-08-06 11:56:12,451 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-46) FINISH, HSMClearTaskVDSCommand, log id: 70bae4e >2012-08-06 11:56:12,452 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-46) FINISH, SPMClearTaskVDSCommand, log id: 2fc70727 >2012-08-06 11:56:12,469 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-34) START, SetVmStatusVDSCommand(vmId = 4dfd7e9a-0245-403d-8fe6-f415f61121af, status = Down), log id: 6f9c2c17 >2012-08-06 11:56:12,471 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-46) BaseAsyncTask::RemoveTaskFromDB: Removed task 9be823df-a864-4833-a4e1-2fe213d161bb from DataBase >2012-08-06 11:56:12,475 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-46) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 66e09847-ee2c-4385-91d2-e7b698d53f85 >2012-08-06 11:56:12,479 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-34) FINISH, SetVmStatusVDSCommand, log id: 6f9c2c17 >2012-08-06 11:56:12,496 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 11:56:12,497 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 11:56:12,558 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-49) SPMAsyncTask::ClearAsyncTask: Attempting to clear task f72e163a-0ee0-4665-a69e-55d926dfb324 >2012-08-06 11:56:12,560 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-49) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = f72e163a-0ee0-4665-a69e-55d926dfb324), log id: 70cde094 >2012-08-06 11:56:12,564 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-34) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 506f148e >2012-08-06 11:56:12,579 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-49) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=f72e163a-0ee0-4665-a69e-55d926dfb324), log id: 7c8306ff >2012-08-06 11:56:12,668 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-49) FINISH, HSMClearTaskVDSCommand, log id: 7c8306ff >2012-08-06 11:56:12,669 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-49) FINISH, SPMClearTaskVDSCommand, log id: 70cde094 >2012-08-06 11:56:12,687 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-49) BaseAsyncTask::RemoveTaskFromDB: Removed task f72e163a-0ee0-4665-a69e-55d926dfb324 from DataBase >2012-08-06 11:56:12,687 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity a6c1ef37-5de7-403f-aecd-0185a55c3046 >2012-08-06 11:56:12,749 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-34) FINISH, UpdateVMVDSCommand, log id: 506f148e >2012-08-06 11:56:12,816 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-34) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 11:56:12,816 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-34) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 11:56:12,841 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-34) SPMAsyncTask::ClearAsyncTask: Attempting to clear task b683051b-a9ac-4427-a593-22559e2ce34d >2012-08-06 11:56:12,842 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-34) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = b683051b-a9ac-4427-a593-22559e2ce34d), log id: 7497cb85 >2012-08-06 11:56:12,866 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-34) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=b683051b-a9ac-4427-a593-22559e2ce34d), log id: e8a2ec6 >2012-08-06 11:56:12,961 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-34) FINISH, HSMClearTaskVDSCommand, log id: e8a2ec6 >2012-08-06 11:56:12,962 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-34) FINISH, SPMClearTaskVDSCommand, log id: 7497cb85 >2012-08-06 11:56:12,985 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-34) BaseAsyncTask::RemoveTaskFromDB: Removed task b683051b-a9ac-4427-a593-22559e2ce34d from DataBase >2012-08-06 11:56:12,986 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-34) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 4dfd7e9a-0245-403d-8fe6-f415f61121af >2012-08-06 11:56:12,991 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) [79b861ec] BaseAsyncTask::StartPollingTask: Starting to poll task e90defa7-0a32-493a-9f32-44698d9e1bd0. >2012-08-06 11:56:12,992 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [79b861ec] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 95b9258b-9b92-4b12-93fa-b5056b9176d9 is AddVm (determined by task e90defa7-0a32-493a-9f32-44698d9e1bd0) >2012-08-06 11:56:13,010 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-48) [73f84f4c] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 11:56:13,102 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) START, SetVmStatusVDSCommand(vmId = 10ef6062-3141-48a6-a778-c79f7a47154e, status = Down), log id: 7891ef4b >2012-08-06 11:56:13,107 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) FINISH, SetVmStatusVDSCommand, log id: 7891ef4b >2012-08-06 11:56:13,228 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-47) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 301f9b56 >2012-08-06 11:56:13,358 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-47) FINISH, UpdateVMVDSCommand, log id: 301f9b56 >2012-08-06 11:56:13,409 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 11:56:13,409 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 11:56:13,440 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) SPMAsyncTask::ClearAsyncTask: Attempting to clear task b3ec18d9-8f17-486d-ba72-d4d71a5bced1 >2012-08-06 11:56:13,441 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-47) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = b3ec18d9-8f17-486d-ba72-d4d71a5bced1), log id: 4227e56 >2012-08-06 11:56:13,471 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-47) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=b3ec18d9-8f17-486d-ba72-d4d71a5bced1), log id: 3ca9e266 >2012-08-06 11:56:13,486 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-45) START, SetVmStatusVDSCommand(vmId = 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94, status = Down), log id: 54dde70f >2012-08-06 11:56:13,493 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-45) FINISH, SetVmStatusVDSCommand, log id: 54dde70f >2012-08-06 11:56:13,567 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-47) FINISH, HSMClearTaskVDSCommand, log id: 3ca9e266 >2012-08-06 11:56:13,568 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-47) FINISH, SPMClearTaskVDSCommand, log id: 4227e56 >2012-08-06 11:56:13,586 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) BaseAsyncTask::RemoveTaskFromDB: Removed task b3ec18d9-8f17-486d-ba72-d4d71a5bced1 from DataBase >2012-08-06 11:56:13,587 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 10ef6062-3141-48a6-a778-c79f7a47154e >2012-08-06 11:56:13,612 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-45) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 2b9a1890 >2012-08-06 11:56:13,682 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-45) FINISH, UpdateVMVDSCommand, log id: 2b9a1890 >2012-08-06 11:56:13,747 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-45) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 11:56:13,748 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-45) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 11:56:13,758 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-44) START, SetVmStatusVDSCommand(vmId = 458adebd-ebe5-46f6-98a5-3359ab42f11b, status = Down), log id: 3bd2dd66 >2012-08-06 11:56:13,761 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-44) FINISH, SetVmStatusVDSCommand, log id: 3bd2dd66 >2012-08-06 11:56:13,782 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-45) SPMAsyncTask::ClearAsyncTask: Attempting to clear task d79765bc-18cc-4f37-8700-e63672b9e784 >2012-08-06 11:56:13,783 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-45) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = d79765bc-18cc-4f37-8700-e63672b9e784), log id: 9b15dae >2012-08-06 11:56:13,797 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-45) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=d79765bc-18cc-4f37-8700-e63672b9e784), log id: 13f59ab9 >2012-08-06 11:56:13,845 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-45) FINISH, HSMClearTaskVDSCommand, log id: 13f59ab9 >2012-08-06 11:56:13,846 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-45) FINISH, SPMClearTaskVDSCommand, log id: 9b15dae >2012-08-06 11:56:13,859 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-45) BaseAsyncTask::RemoveTaskFromDB: Removed task d79765bc-18cc-4f37-8700-e63672b9e784 from DataBase >2012-08-06 11:56:13,860 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-45) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94 >2012-08-06 11:56:13,877 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-44) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 77656d7 >2012-08-06 11:56:13,939 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-44) FINISH, UpdateVMVDSCommand, log id: 77656d7 >2012-08-06 11:56:13,984 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 11:56:13,985 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 11:56:14,009 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) SPMAsyncTask::ClearAsyncTask: Attempting to clear task c0ed5faa-0378-4837-a0a2-f64ffac1cd0e >2012-08-06 11:56:14,010 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = c0ed5faa-0378-4837-a0a2-f64ffac1cd0e), log id: 26f8a7da >2012-08-06 11:56:14,024 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-43) START, SetVmStatusVDSCommand(vmId = ad77ef63-994a-4f05-ae14-9488e891a059, status = Down), log id: 27bf4eef >2012-08-06 11:56:14,029 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-43) FINISH, SetVmStatusVDSCommand, log id: 27bf4eef >2012-08-06 11:56:14,034 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=c0ed5faa-0378-4837-a0a2-f64ffac1cd0e), log id: 5b82315b >2012-08-06 11:56:14,089 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) FINISH, HSMClearTaskVDSCommand, log id: 5b82315b >2012-08-06 11:56:14,089 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) FINISH, SPMClearTaskVDSCommand, log id: 26f8a7da >2012-08-06 11:56:14,136 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) BaseAsyncTask::RemoveTaskFromDB: Removed task c0ed5faa-0378-4837-a0a2-f64ffac1cd0e from DataBase >2012-08-06 11:56:14,136 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 458adebd-ebe5-46f6-98a5-3359ab42f11b >2012-08-06 11:56:14,226 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-43) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 7367a9eb >2012-08-06 11:56:14,280 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-43) FINISH, UpdateVMVDSCommand, log id: 7367a9eb >2012-08-06 11:56:14,345 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-42) START, SetVmStatusVDSCommand(vmId = c26afa24-84a3-4a85-939b-c8b0b293a8e9, status = Down), log id: 3918f80a >2012-08-06 11:56:14,349 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-42) FINISH, SetVmStatusVDSCommand, log id: 3918f80a >2012-08-06 11:56:14,350 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-43) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 11:56:14,351 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-43) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 11:56:14,423 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-42) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 40319c37 >2012-08-06 11:56:14,445 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-43) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 2eff1a48-34f0-4aef-a7d7-3eb1638c7a7e >2012-08-06 11:56:14,446 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-43) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 2eff1a48-34f0-4aef-a7d7-3eb1638c7a7e), log id: 3a8429ce >2012-08-06 11:56:14,483 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-42) FINISH, UpdateVMVDSCommand, log id: 40319c37 >2012-08-06 11:56:14,496 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-43) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=2eff1a48-34f0-4aef-a7d7-3eb1638c7a7e), log id: 567a463c >2012-08-06 11:56:14,531 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 11:56:14,532 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 11:56:14,538 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-43) FINISH, HSMClearTaskVDSCommand, log id: 567a463c >2012-08-06 11:56:14,538 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-43) FINISH, SPMClearTaskVDSCommand, log id: 3a8429ce >2012-08-06 11:56:14,571 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-43) BaseAsyncTask::RemoveTaskFromDB: Removed task 2eff1a48-34f0-4aef-a7d7-3eb1638c7a7e from DataBase >2012-08-06 11:56:14,571 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-43) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity ad77ef63-994a-4f05-ae14-9488e891a059 >2012-08-06 11:56:14,615 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-42) SPMAsyncTask::ClearAsyncTask: Attempting to clear task e559d483-1ea0-44c4-8ac3-4cf8c51ed4d6 >2012-08-06 11:56:14,616 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-42) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = e559d483-1ea0-44c4-8ac3-4cf8c51ed4d6), log id: 37b68667 >2012-08-06 11:56:14,625 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-42) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=e559d483-1ea0-44c4-8ac3-4cf8c51ed4d6), log id: 289f6332 >2012-08-06 11:56:14,656 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-42) FINISH, HSMClearTaskVDSCommand, log id: 289f6332 >2012-08-06 11:56:14,656 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-42) FINISH, SPMClearTaskVDSCommand, log id: 37b68667 >2012-08-06 11:56:14,669 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-42) BaseAsyncTask::RemoveTaskFromDB: Removed task e559d483-1ea0-44c4-8ac3-4cf8c51ed4d6 from DataBase >2012-08-06 11:56:14,670 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity c26afa24-84a3-4a85-939b-c8b0b293a8e9 >2012-08-06 11:56:20,084 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-51) Polling and updating Async Tasks: 16 tasks, 3 tasks to poll now >2012-08-06 11:56:20,112 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-51) SPMAsyncTask::PollTask: Polling task e90defa7-0a32-493a-9f32-44698d9e1bd0 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 11:56:20,143 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-51) BaseAsyncTask::OnTaskEndSuccess: Task e90defa7-0a32-493a-9f32-44698d9e1bd0 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 11:56:20,144 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-51) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 95b9258b-9b92-4b12-93fa-b5056b9176d9 has ended -> executing EndAction >2012-08-06 11:56:20,145 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-51) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 95b9258b-9b92-4b12-93fa-b5056b9176d9): calling EndAction for action type AddVm. >2012-08-06 11:56:20,146 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 11:56:20,151 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-51) SPMAsyncTask::PollTask: Polling task bdbdaefa-f354-4436-a836-b0d5e7b37eba (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 11:56:20,179 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-51) BaseAsyncTask::OnTaskEndSuccess: Task bdbdaefa-f354-4436-a836-b0d5e7b37eba (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 11:56:20,181 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-51) EntityAsyncTask::EndActionIfNecessary: All tasks of entity de370719-d4d0-4299-93d6-2fc4a274aa28 has ended -> executing EndAction >2012-08-06 11:56:20,181 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-51) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: de370719-d4d0-4299-93d6-2fc4a274aa28): calling EndAction for action type AddVm. >2012-08-06 11:56:20,184 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-43) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 11:56:20,191 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-51) SPMAsyncTask::PollTask: Polling task 1695531c-f7f2-43e5-95d1-7e772e89c106 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 11:56:20,216 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-51) BaseAsyncTask::OnTaskEndSuccess: Task 1695531c-f7f2-43e5-95d1-7e772e89c106 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 11:56:20,217 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-51) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 3ee28762-5b38-409a-8e34-aebd1ed491f6 has ended -> executing EndAction >2012-08-06 11:56:20,218 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-51) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 3ee28762-5b38-409a-8e34-aebd1ed491f6): calling EndAction for action type AddVm. >2012-08-06 11:56:20,218 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 11:56:20,269 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-42) [12e8e861] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 11:56:20,269 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-42) [79b861ec] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 11:56:20,285 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-42) [79b861ec] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 530b2043-4d0e-433d-9e43-562abe9fcf93, imageId = c5ae4b5c-e31c-40b9-ade3-5ddcb15230a6), log id: 43f9eb29 >2012-08-06 11:56:20,334 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-43) [1dfa8c4a] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 11:56:20,335 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-43) [646644d0] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 11:56:20,344 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-43) [646644d0] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0dc3326b-6e58-4117-8d83-77ab85529263, imageId = 5d9440e0-78c8-494c-99f1-81b9bca8a8ac), log id: 1697a6b1 >2012-08-06 11:56:20,370 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-42) [79b861ec] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@fd32ee90, log id: 43f9eb29 >2012-08-06 11:56:20,380 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-44) [583b4ac9] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 11:56:20,381 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-44) [271c6110] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 11:56:20,394 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-44) [271c6110] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 7f7d0278-869e-4ed6-8277-6df2825a57d2, imageId = 0ce57ab9-0e61-4891-8137-77587ab0f124), log id: 3faac18c >2012-08-06 11:56:20,409 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-42) START, SetVmStatusVDSCommand(vmId = 95b9258b-9b92-4b12-93fa-b5056b9176d9, status = Down), log id: 3cf78cef >2012-08-06 11:56:20,420 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-42) FINISH, SetVmStatusVDSCommand, log id: 3cf78cef >2012-08-06 11:56:20,455 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-42) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 6a9f2c03 >2012-08-06 11:56:20,474 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-43) [646644d0] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@9e637c97, log id: 1697a6b1 >2012-08-06 11:56:20,549 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-42) FINISH, UpdateVMVDSCommand, log id: 6a9f2c03 >2012-08-06 11:56:20,589 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-43) START, SetVmStatusVDSCommand(vmId = de370719-d4d0-4299-93d6-2fc4a274aa28, status = Down), log id: 6aa3b24c >2012-08-06 11:56:20,595 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-43) FINISH, SetVmStatusVDSCommand, log id: 6aa3b24c >2012-08-06 11:56:20,610 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 11:56:20,611 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 11:56:20,628 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-44) [271c6110] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@3bafa68c, log id: 3faac18c >2012-08-06 11:56:20,653 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-43) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 63ebfdb >2012-08-06 11:56:20,673 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-42) SPMAsyncTask::ClearAsyncTask: Attempting to clear task e90defa7-0a32-493a-9f32-44698d9e1bd0 >2012-08-06 11:56:20,674 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-42) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = e90defa7-0a32-493a-9f32-44698d9e1bd0), log id: 44e670ad >2012-08-06 11:56:20,704 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-43) FINISH, UpdateVMVDSCommand, log id: 63ebfdb >2012-08-06 11:56:20,707 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-42) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=e90defa7-0a32-493a-9f32-44698d9e1bd0), log id: e20fe01 >2012-08-06 11:56:20,748 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-44) START, SetVmStatusVDSCommand(vmId = 3ee28762-5b38-409a-8e34-aebd1ed491f6, status = Down), log id: 3c3aa58d >2012-08-06 11:56:20,756 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-44) FINISH, SetVmStatusVDSCommand, log id: 3c3aa58d >2012-08-06 11:56:20,760 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-42) FINISH, HSMClearTaskVDSCommand, log id: e20fe01 >2012-08-06 11:56:20,760 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-42) FINISH, SPMClearTaskVDSCommand, log id: 44e670ad >2012-08-06 11:56:20,792 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-43) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 11:56:20,792 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-43) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 11:56:20,811 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-42) BaseAsyncTask::RemoveTaskFromDB: Removed task e90defa7-0a32-493a-9f32-44698d9e1bd0 from DataBase >2012-08-06 11:56:20,812 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 95b9258b-9b92-4b12-93fa-b5056b9176d9 >2012-08-06 11:56:20,827 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-44) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 769d6f0f >2012-08-06 11:56:20,861 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-43) SPMAsyncTask::ClearAsyncTask: Attempting to clear task bdbdaefa-f354-4436-a836-b0d5e7b37eba >2012-08-06 11:56:20,862 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-43) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = bdbdaefa-f354-4436-a836-b0d5e7b37eba), log id: 2f2db1ab >2012-08-06 11:56:20,864 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-44) FINISH, UpdateVMVDSCommand, log id: 769d6f0f >2012-08-06 11:56:20,866 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-43) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=bdbdaefa-f354-4436-a836-b0d5e7b37eba), log id: 23a9f30b >2012-08-06 11:56:20,896 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-43) FINISH, HSMClearTaskVDSCommand, log id: 23a9f30b >2012-08-06 11:56:20,896 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-43) FINISH, SPMClearTaskVDSCommand, log id: 2f2db1ab >2012-08-06 11:56:20,908 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 11:56:20,909 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 11:56:20,922 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-43) BaseAsyncTask::RemoveTaskFromDB: Removed task bdbdaefa-f354-4436-a836-b0d5e7b37eba from DataBase >2012-08-06 11:56:20,923 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-43) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity de370719-d4d0-4299-93d6-2fc4a274aa28 >2012-08-06 11:56:21,001 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 1695531c-f7f2-43e5-95d1-7e772e89c106 >2012-08-06 11:56:21,002 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 1695531c-f7f2-43e5-95d1-7e772e89c106), log id: 10ce660e >2012-08-06 11:56:21,005 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=1695531c-f7f2-43e5-95d1-7e772e89c106), log id: 4a40b1ff >2012-08-06 11:56:21,036 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) FINISH, HSMClearTaskVDSCommand, log id: 4a40b1ff >2012-08-06 11:56:21,037 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) FINISH, SPMClearTaskVDSCommand, log id: 10ce660e >2012-08-06 11:56:21,051 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) BaseAsyncTask::RemoveTaskFromDB: Removed task 1695531c-f7f2-43e5-95d1-7e772e89c106 from DataBase >2012-08-06 11:56:21,052 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 3ee28762-5b38-409a-8e34-aebd1ed491f6 >2012-08-06 11:56:26,836 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-70) Setting new tasks map. The map contains now 15 tasks >2012-08-06 11:57:26,837 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-67) Setting new tasks map. The map contains now 0 tasks >2012-08-06 11:57:26,838 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-67) Cleared all tasks of pool efe20197-e0a7-49b8-beb4-19b1ed3f8c3f. >2012-08-06 11:57:26,840 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-67) Could not find vds that is spm and non-operational. >2012-08-06 11:58:00,499 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) Start time: 8/6/12 11:58 AM. Start running CanDoAction for command number 1/10 (Command type: RunVm) >2012-08-06 11:58:00,500 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/6/12 11:58 AM. Start running CanDoAction for command number 2/10 (Command type: RunVm) >2012-08-06 11:58:00,501 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) Start time: 8/6/12 11:58 AM. Start running CanDoAction for command number 3/10 (Command type: RunVm) >2012-08-06 11:58:00,503 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/6/12 11:58 AM. Start running CanDoAction for command number 4/10 (Command type: RunVm) >2012-08-06 11:58:00,506 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/6/12 11:58 AM. Start running CanDoAction for command number 5/10 (Command type: RunVm) >2012-08-06 11:58:00,507 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-34) Start time: 8/6/12 11:58 AM. Start running CanDoAction for command number 6/10 (Command type: RunVm) >2012-08-06 11:58:00,510 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) Start time: 8/6/12 11:58 AM. Start running CanDoAction for command number 7/10 (Command type: RunVm) >2012-08-06 11:58:00,513 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/6/12 11:58 AM. Start running CanDoAction for command number 8/10 (Command type: RunVm) >2012-08-06 11:58:00,516 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) Start time: 8/6/12 11:58 AM. Start running CanDoAction for command number 9/10 (Command type: RunVm) >2012-08-06 11:58:00,519 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/6/12 11:58 AM. Start running CanDoAction for command number 10/10 (Command type: RunVm) >2012-08-06 11:58:00,573 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) Lock Acquired to object EngineLock [exclusiveLocks= key: ad77ef63-994a-4f05-ae14-9488e891a059 value: VM >, sharedLocks= ] >2012-08-06 11:58:00,586 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-44) Lock Acquired to object EngineLock [exclusiveLocks= key: 6a8ef0f6-c139-41d9-a814-60ca51daa5f4 value: VM >, sharedLocks= ] >2012-08-06 11:58:00,586 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) Lock Acquired to object EngineLock [exclusiveLocks= key: a6c1ef37-5de7-403f-aecd-0185a55c3046 value: VM >, sharedLocks= ] >2012-08-06 11:58:00,598 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-43) Lock Acquired to object EngineLock [exclusiveLocks= key: 458adebd-ebe5-46f6-98a5-3359ab42f11b value: VM >, sharedLocks= ] >2012-08-06 11:58:00,605 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-34) Lock Acquired to object EngineLock [exclusiveLocks= key: 3ee28762-5b38-409a-8e34-aebd1ed491f6 value: VM >, sharedLocks= ] >2012-08-06 11:58:00,614 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) Lock Acquired to object EngineLock [exclusiveLocks= key: e047ae8c-befe-4805-bc8c-929bb3408fbe value: VM >, sharedLocks= ] >2012-08-06 11:58:00,616 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-47) Lock Acquired to object EngineLock [exclusiveLocks= key: de370719-d4d0-4299-93d6-2fc4a274aa28 value: VM >, sharedLocks= ] >2012-08-06 11:58:00,623 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) Lock Acquired to object EngineLock [exclusiveLocks= key: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 value: VM >, sharedLocks= ] >2012-08-06 11:58:00,624 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) Lock Acquired to object EngineLock [exclusiveLocks= key: 95b9258b-9b92-4b12-93fa-b5056b9176d9 value: VM >, sharedLocks= ] >2012-08-06 11:58:00,626 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) Lock Acquired to object EngineLock [exclusiveLocks= key: 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3 value: VM >, sharedLocks= ] >2012-08-06 11:58:00,902 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6c02bcd5 >2012-08-06 11:58:00,904 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) FINISH, IsValidVDSCommand, return: true, log id: 6c02bcd5 >2012-08-06 11:58:00,909 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 5a4b4b36 >2012-08-06 11:58:00,910 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) FINISH, IsValidVDSCommand, return: true, log id: 5a4b4b36 >2012-08-06 11:58:00,922 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-44) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 338cdccb >2012-08-06 11:58:00,924 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-44) FINISH, IsValidVDSCommand, return: true, log id: 338cdccb >2012-08-06 11:58:01,182 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-34) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 51ac5fda >2012-08-06 11:58:01,187 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 5b56c4f >2012-08-06 11:58:01,188 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) FINISH, IsValidVDSCommand, return: true, log id: 5b56c4f >2012-08-06 11:58:01,190 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6af6f530 >2012-08-06 11:58:01,191 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) FINISH, IsValidVDSCommand, return: true, log id: 6af6f530 >2012-08-06 11:58:01,194 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: f5b8053 >2012-08-06 11:58:01,195 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) FINISH, IsValidVDSCommand, return: true, log id: f5b8053 >2012-08-06 11:58:01,203 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-47) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 2aba44c2 >2012-08-06 11:58:01,204 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-47) FINISH, IsValidVDSCommand, return: true, log id: 2aba44c2 >2012-08-06 11:58:01,219 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-34) FINISH, IsValidVDSCommand, return: true, log id: 51ac5fda >2012-08-06 11:58:01,264 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-43) START, IsVmDuringInitiatingVDSCommand(vmId = 458adebd-ebe5-46f6-98a5-3359ab42f11b), log id: 51200751 >2012-08-06 11:58:01,265 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-43) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 51200751 >2012-08-06 11:58:01,290 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-44) START, IsVmDuringInitiatingVDSCommand(vmId = 6a8ef0f6-c139-41d9-a814-60ca51daa5f4), log id: 2d382496 >2012-08-06 11:58:01,301 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-44) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 2d382496 >2012-08-06 11:58:01,597 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) End time: 8/6/12 11:58 AM. Finish handling CanDoAction for command number 1/10 (Command type: RunVm) >2012-08-06 11:58:01,734 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-48) START, IsVmDuringInitiatingVDSCommand(vmId = 95b9258b-9b92-4b12-93fa-b5056b9176d9), log id: 7364cd1b >2012-08-06 11:58:01,735 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-48) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 7364cd1b >2012-08-06 11:58:01,737 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/6/12 11:58 AM. Finish handling CanDoAction for command number 2/10 (Command type: RunVm) >2012-08-06 11:58:01,735 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) START, IsVmDuringInitiatingVDSCommand(vmId = 3c5452c9-a5e2-46af-90b5-b568da5dc3d4), log id: 2c1cefb8 >2012-08-06 11:58:01,739 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 2c1cefb8 >2012-08-06 11:58:01,735 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) START, IsVmDuringInitiatingVDSCommand(vmId = ad77ef63-994a-4f05-ae14-9488e891a059), log id: 12dc0ba2 >2012-08-06 11:58:01,741 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 12dc0ba2 >2012-08-06 11:58:01,751 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-34) START, IsVmDuringInitiatingVDSCommand(vmId = 3ee28762-5b38-409a-8e34-aebd1ed491f6), log id: 707560 >2012-08-06 11:58:01,752 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-34) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 707560 >2012-08-06 11:58:01,782 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/6/12 11:58 AM. Finish handling CanDoAction for command number 8/10 (Command type: RunVm) >2012-08-06 11:58:01,790 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-42) START, IsVmDuringInitiatingVDSCommand(vmId = a6c1ef37-5de7-403f-aecd-0185a55c3046), log id: 7ee1d1c8 >2012-08-06 11:58:01,791 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-42) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 7ee1d1c8 >2012-08-06 11:58:01,862 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-34) End time: 8/6/12 11:58 AM. Finish handling CanDoAction for command number 6/10 (Command type: RunVm) >2012-08-06 11:58:01,865 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/6/12 11:58 AM. Finish handling CanDoAction for command number 4/10 (Command type: RunVm) >2012-08-06 11:58:01,872 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) End time: 8/6/12 11:58 AM. Finish handling CanDoAction for command number 7/10 (Command type: RunVm) >2012-08-06 11:58:01,876 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) End time: 8/6/12 11:58 AM. Finish handling CanDoAction for command number 3/10 (Command type: RunVm) >2012-08-06 11:58:02,466 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-47) START, IsVmDuringInitiatingVDSCommand(vmId = de370719-d4d0-4299-93d6-2fc4a274aa28), log id: 54d57e25 >2012-08-06 11:58:02,467 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-47) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 54d57e25 >2012-08-06 11:58:02,555 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/6/12 11:58 AM. Finish handling CanDoAction for command number 5/10 (Command type: RunVm) >2012-08-06 11:58:02,599 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 34f2d94f >2012-08-06 11:58:02,611 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) FINISH, IsValidVDSCommand, return: true, log id: 34f2d94f >2012-08-06 11:58:02,903 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 3fe2580d >2012-08-06 11:58:02,907 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) FINISH, IsValidVDSCommand, return: true, log id: 3fe2580d >2012-08-06 11:58:02,909 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) START, IsVmDuringInitiatingVDSCommand(vmId = 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3), log id: 7d13e33a >2012-08-06 11:58:02,909 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 7d13e33a >2012-08-06 11:58:02,928 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) End time: 8/6/12 11:58 AM. Finish handling CanDoAction for command number 9/10 (Command type: RunVm) >2012-08-06 11:58:05,072 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) START, IsVmDuringInitiatingVDSCommand(vmId = e047ae8c-befe-4805-bc8c-929bb3408fbe), log id: 5c373b19 >2012-08-06 11:58:05,075 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 5c373b19 >2012-08-06 11:58:05,150 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/6/12 11:58 AM. Finish handling CanDoAction for command number 10/10 (Command type: RunVm) >2012-08-06 11:58:05,151 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) Start time: 8/6/12 11:58 AM. Start running CanDoAction for command number 12/16 (Command type: RunVm) >2012-08-06 11:58:05,152 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/6/12 11:58 AM. Start running CanDoAction for command number 13/16 (Command type: RunVm) >2012-08-06 11:58:05,153 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) Start time: 8/6/12 11:58 AM. Start running CanDoAction for command number 14/16 (Command type: RunVm) >2012-08-06 11:58:05,154 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) Start time: 8/6/12 11:58 AM. Start running CanDoAction for command number 15/16 (Command type: RunVm) >2012-08-06 11:58:05,155 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/6/12 11:58 AM. Start running CanDoAction for command number 16/16 (Command type: RunVm) >2012-08-06 11:58:05,163 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/6/12 11:58 AM. Start running CanDoAction for command number 11/16 (Command type: RunVm) >2012-08-06 11:58:05,184 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) Lock Acquired to object EngineLock [exclusiveLocks= key: c26afa24-84a3-4a85-939b-c8b0b293a8e9 value: VM >, sharedLocks= ] >2012-08-06 11:58:05,188 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-47) Lock Acquired to object EngineLock [exclusiveLocks= key: 66e09847-ee2c-4385-91d2-e7b698d53f85 value: VM >, sharedLocks= ] >2012-08-06 11:58:05,191 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) Lock Acquired to object EngineLock [exclusiveLocks= key: 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94 value: VM >, sharedLocks= ] >2012-08-06 11:58:05,195 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) Lock Acquired to object EngineLock [exclusiveLocks= key: ba81adbe-b311-4aef-b6c1-5f84f0f3c94d value: VM >, sharedLocks= ] >2012-08-06 11:58:05,198 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) Lock Acquired to object EngineLock [exclusiveLocks= key: 4dfd7e9a-0245-403d-8fe6-f415f61121af value: VM >, sharedLocks= ] >2012-08-06 11:58:05,215 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) Lock Acquired to object EngineLock [exclusiveLocks= key: 10ef6062-3141-48a6-a778-c79f7a47154e value: VM >, sharedLocks= ] >2012-08-06 11:58:05,223 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-47) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 17ef6b28 >2012-08-06 11:58:05,234 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-47) FINISH, IsValidVDSCommand, return: true, log id: 17ef6b28 >2012-08-06 11:58:05,264 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 47bba7c9 >2012-08-06 11:58:05,266 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) FINISH, IsValidVDSCommand, return: true, log id: 47bba7c9 >2012-08-06 11:58:05,335 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-47) START, IsVmDuringInitiatingVDSCommand(vmId = 66e09847-ee2c-4385-91d2-e7b698d53f85), log id: 560c739b >2012-08-06 11:58:05,335 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-47) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 560c739b >2012-08-06 11:58:05,375 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/6/12 11:58 AM. Finish handling CanDoAction for command number 13/16 (Command type: RunVm) >2012-08-06 11:58:05,382 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) START, IsVmDuringInitiatingVDSCommand(vmId = 10ef6062-3141-48a6-a778-c79f7a47154e), log id: 3c8c6292 >2012-08-06 11:58:05,382 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 3c8c6292 >2012-08-06 11:58:05,389 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) End time: 8/6/12 11:58 AM. Finish handling CanDoAction for command number 12/16 (Command type: RunVm) >2012-08-06 11:58:05,398 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 3288f0db >2012-08-06 11:58:05,399 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) FINISH, IsValidVDSCommand, return: true, log id: 3288f0db >2012-08-06 11:58:05,404 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1846204 >2012-08-06 11:58:05,406 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) FINISH, IsValidVDSCommand, return: true, log id: 1846204 >2012-08-06 11:58:05,409 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 2e548ffe >2012-08-06 11:58:05,411 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) FINISH, IsValidVDSCommand, return: true, log id: 2e548ffe >2012-08-06 11:58:05,545 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-42) START, IsVmDuringInitiatingVDSCommand(vmId = 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94), log id: 65540c41 >2012-08-06 11:58:05,546 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-42) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 65540c41 >2012-08-06 11:58:05,554 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) End time: 8/6/12 11:58 AM. Finish handling CanDoAction for command number 14/16 (Command type: RunVm) >2012-08-06 11:58:05,586 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) START, IsVmDuringInitiatingVDSCommand(vmId = 4dfd7e9a-0245-403d-8fe6-f415f61121af), log id: d9b39bf >2012-08-06 11:58:05,587 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: d9b39bf >2012-08-06 11:58:05,589 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) START, IsVmDuringInitiatingVDSCommand(vmId = ba81adbe-b311-4aef-b6c1-5f84f0f3c94d), log id: 2275024b >2012-08-06 11:58:05,590 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 2275024b >2012-08-06 11:58:05,602 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/6/12 11:58 AM. Finish handling CanDoAction for command number 11/16 (Command type: RunVm) >2012-08-06 11:58:05,604 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/6/12 11:58 AM. Finish handling CanDoAction for command number 16/16 (Command type: RunVm) >2012-08-06 11:58:05,688 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1704446e >2012-08-06 11:58:05,690 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) FINISH, IsValidVDSCommand, return: true, log id: 1704446e >2012-08-06 11:58:05,720 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-48) START, IsVmDuringInitiatingVDSCommand(vmId = c26afa24-84a3-4a85-939b-c8b0b293a8e9), log id: 2e43f389 >2012-08-06 11:58:05,720 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-48) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 2e43f389 >2012-08-06 11:58:05,730 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) End time: 8/6/12 11:58 AM. Finish handling CanDoAction for command number 15/16 (Command type: RunVm) >2012-08-06 11:58:05,836 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [5775e51f] Running command: RunVmCommand internal: false. Entities affected : ID: ba81adbe-b311-4aef-b6c1-5f84f0f3c94d Type: VM >2012-08-06 11:58:05,858 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [5775e51f] Cant find VDS to run the VM ba81adbe-b311-4aef-b6c1-5f84f0f3c94d on, so this VM will not be run. >2012-08-06 11:58:05,881 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [5775e51f] Lock freed to object EngineLock [exclusiveLocks= key: ba81adbe-b311-4aef-b6c1-5f84f0f3c94d value: VM >, sharedLocks= ] >2012-08-06 11:58:05,986 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [68095773] Running command: RunVmCommand internal: false. Entities affected : ID: 6a8ef0f6-c139-41d9-a814-60ca51daa5f4 Type: VM >2012-08-06 11:58:06,004 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [68095773] Cant find VDS to run the VM 6a8ef0f6-c139-41d9-a814-60ca51daa5f4 on, so this VM will not be run. >2012-08-06 11:58:06,022 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [68095773] Lock freed to object EngineLock [exclusiveLocks= key: 6a8ef0f6-c139-41d9-a814-60ca51daa5f4 value: VM >, sharedLocks= ] >2012-08-06 11:58:06,104 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [6e5aefaf] Running command: RunVmCommand internal: false. Entities affected : ID: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 Type: VM >2012-08-06 11:58:06,113 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [6e5aefaf] Cant find VDS to run the VM 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 on, so this VM will not be run. >2012-08-06 11:58:06,130 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [6e5aefaf] Lock freed to object EngineLock [exclusiveLocks= key: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 value: VM >, sharedLocks= ] >2012-08-06 11:58:06,202 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [695ac6b0] Running command: RunVmCommand internal: false. Entities affected : ID: 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3 Type: VM >2012-08-06 11:58:06,211 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [695ac6b0] Cant find VDS to run the VM 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3 on, so this VM will not be run. >2012-08-06 11:58:06,240 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [695ac6b0] Lock freed to object EngineLock [exclusiveLocks= key: 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3 value: VM >, sharedLocks= ] >2012-08-06 11:58:06,326 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [16a1e781] Running command: RunVmCommand internal: false. Entities affected : ID: e047ae8c-befe-4805-bc8c-929bb3408fbe Type: VM >2012-08-06 11:58:06,334 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [16a1e781] Cant find VDS to run the VM e047ae8c-befe-4805-bc8c-929bb3408fbe on, so this VM will not be run. >2012-08-06 11:58:06,352 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [16a1e781] Lock freed to object EngineLock [exclusiveLocks= key: e047ae8c-befe-4805-bc8c-929bb3408fbe value: VM >, sharedLocks= ] >2012-08-06 11:58:06,495 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [311c2b3a] Running command: RunVmCommand internal: false. Entities affected : ID: 4dfd7e9a-0245-403d-8fe6-f415f61121af Type: VM >2012-08-06 11:58:06,510 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [311c2b3a] Cant find VDS to run the VM 4dfd7e9a-0245-403d-8fe6-f415f61121af on, so this VM will not be run. >2012-08-06 11:58:06,527 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [311c2b3a] Lock freed to object EngineLock [exclusiveLocks= key: 4dfd7e9a-0245-403d-8fe6-f415f61121af value: VM >, sharedLocks= ] >2012-08-06 11:58:06,620 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [b350660] Running command: RunVmCommand internal: false. Entities affected : ID: 10ef6062-3141-48a6-a778-c79f7a47154e Type: VM >2012-08-06 11:58:06,629 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [b350660] Cant find VDS to run the VM 10ef6062-3141-48a6-a778-c79f7a47154e on, so this VM will not be run. >2012-08-06 11:58:06,646 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [b350660] Lock freed to object EngineLock [exclusiveLocks= key: 10ef6062-3141-48a6-a778-c79f7a47154e value: VM >, sharedLocks= ] >2012-08-06 11:58:06,770 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [56373d24] Running command: RunVmCommand internal: false. Entities affected : ID: 66e09847-ee2c-4385-91d2-e7b698d53f85 Type: VM >2012-08-06 11:58:06,779 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [56373d24] Cant find VDS to run the VM 66e09847-ee2c-4385-91d2-e7b698d53f85 on, so this VM will not be run. >2012-08-06 11:58:06,793 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [56373d24] Lock freed to object EngineLock [exclusiveLocks= key: 66e09847-ee2c-4385-91d2-e7b698d53f85 value: VM >, sharedLocks= ] >2012-08-06 11:58:06,921 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [337c858] Running command: RunVmCommand internal: false. Entities affected : ID: 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94 Type: VM >2012-08-06 11:58:06,930 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [337c858] Cant find VDS to run the VM 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94 on, so this VM will not be run. >2012-08-06 11:58:06,949 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [337c858] Lock freed to object EngineLock [exclusiveLocks= key: 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94 value: VM >, sharedLocks= ] >2012-08-06 11:58:07,123 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [1a4a9e4e] Running command: RunVmCommand internal: false. Entities affected : ID: c26afa24-84a3-4a85-939b-c8b0b293a8e9 Type: VM >2012-08-06 11:58:07,132 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [1a4a9e4e] Cant find VDS to run the VM c26afa24-84a3-4a85-939b-c8b0b293a8e9 on, so this VM will not be run. >2012-08-06 11:58:07,149 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [1a4a9e4e] Lock freed to object EngineLock [exclusiveLocks= key: c26afa24-84a3-4a85-939b-c8b0b293a8e9 value: VM >, sharedLocks= ] >2012-08-06 11:58:07,243 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [22024dcc] Running command: RunVmCommand internal: false. Entities affected : ID: 458adebd-ebe5-46f6-98a5-3359ab42f11b Type: VM >2012-08-06 11:58:07,251 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [22024dcc] Cant find VDS to run the VM 458adebd-ebe5-46f6-98a5-3359ab42f11b on, so this VM will not be run. >2012-08-06 11:58:07,269 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [22024dcc] Lock freed to object EngineLock [exclusiveLocks= key: 458adebd-ebe5-46f6-98a5-3359ab42f11b value: VM >, sharedLocks= ] >2012-08-06 11:58:07,396 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [e624ec8] Running command: RunVmCommand internal: false. Entities affected : ID: a6c1ef37-5de7-403f-aecd-0185a55c3046 Type: VM >2012-08-06 11:58:07,405 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [e624ec8] Cant find VDS to run the VM a6c1ef37-5de7-403f-aecd-0185a55c3046 on, so this VM will not be run. >2012-08-06 11:58:07,423 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [e624ec8] Lock freed to object EngineLock [exclusiveLocks= key: a6c1ef37-5de7-403f-aecd-0185a55c3046 value: VM >, sharedLocks= ] >2012-08-06 11:58:07,520 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [5a5ea5d6] Running command: RunVmCommand internal: false. Entities affected : ID: ad77ef63-994a-4f05-ae14-9488e891a059 Type: VM >2012-08-06 11:58:07,529 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [5a5ea5d6] Cant find VDS to run the VM ad77ef63-994a-4f05-ae14-9488e891a059 on, so this VM will not be run. >2012-08-06 11:58:07,554 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [5a5ea5d6] Lock freed to object EngineLock [exclusiveLocks= key: ad77ef63-994a-4f05-ae14-9488e891a059 value: VM >, sharedLocks= ] >2012-08-06 11:58:07,634 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [349f03d9] Running command: RunVmCommand internal: false. Entities affected : ID: de370719-d4d0-4299-93d6-2fc4a274aa28 Type: VM >2012-08-06 11:58:07,643 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [349f03d9] Cant find VDS to run the VM de370719-d4d0-4299-93d6-2fc4a274aa28 on, so this VM will not be run. >2012-08-06 11:58:07,660 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [349f03d9] Lock freed to object EngineLock [exclusiveLocks= key: de370719-d4d0-4299-93d6-2fc4a274aa28 value: VM >, sharedLocks= ] >2012-08-06 11:58:07,745 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [5716cf5a] Running command: RunVmCommand internal: false. Entities affected : ID: 3ee28762-5b38-409a-8e34-aebd1ed491f6 Type: VM >2012-08-06 11:58:07,753 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [5716cf5a] Cant find VDS to run the VM 3ee28762-5b38-409a-8e34-aebd1ed491f6 on, so this VM will not be run. >2012-08-06 11:58:07,771 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [5716cf5a] Lock freed to object EngineLock [exclusiveLocks= key: 3ee28762-5b38-409a-8e34-aebd1ed491f6 value: VM >, sharedLocks= ] >2012-08-06 11:58:07,861 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [a2892ff] Running command: RunVmCommand internal: false. Entities affected : ID: 95b9258b-9b92-4b12-93fa-b5056b9176d9 Type: VM >2012-08-06 11:58:07,870 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [a2892ff] Cant find VDS to run the VM 95b9258b-9b92-4b12-93fa-b5056b9176d9 on, so this VM will not be run. >2012-08-06 11:58:07,888 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [a2892ff] Lock freed to object EngineLock [exclusiveLocks= key: 95b9258b-9b92-4b12-93fa-b5056b9176d9 value: VM >, sharedLocks= ] >2012-08-06 12:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) Checking autorecoverable hosts >2012-08-06 12:00:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) Autorecovering 0 hosts >2012-08-06 12:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) Checking autorecoverable hosts done >2012-08-06 12:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) Checking autorecoverable storage domains >2012-08-06 12:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) Autorecovering 0 storage domains >2012-08-06 12:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) Checking autorecoverable storage domains done >2012-08-06 12:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable hosts >2012-08-06 12:05:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Autorecovering 0 hosts >2012-08-06 12:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable hosts done >2012-08-06 12:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable storage domains >2012-08-06 12:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Autorecovering 0 storage domains >2012-08-06 12:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable storage domains done >2012-08-06 12:09:01,679 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/6/12 12:09 PM. Start running CanDoAction for command number 9/9 (Command type: RunVm) >2012-08-06 12:09:01,681 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/6/12 12:09 PM. Start running CanDoAction for command number 8/9 (Command type: RunVm) >2012-08-06 12:09:01,683 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-34) Start time: 8/6/12 12:09 PM. Start running CanDoAction for command number 7/9 (Command type: RunVm) >2012-08-06 12:09:01,686 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/6/12 12:09 PM. Start running CanDoAction for command number 6/9 (Command type: RunVm) >2012-08-06 12:09:01,689 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) Start time: 8/6/12 12:09 PM. Start running CanDoAction for command number 5/9 (Command type: RunVm) >2012-08-06 12:09:01,691 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) Start time: 8/6/12 12:09 PM. Start running CanDoAction for command number 4/9 (Command type: RunVm) >2012-08-06 12:09:01,692 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/6/12 12:09 PM. Start running CanDoAction for command number 3/9 (Command type: RunVm) >2012-08-06 12:09:01,696 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) Start time: 8/6/12 12:09 PM. Start running CanDoAction for command number 2/9 (Command type: RunVm) >2012-08-06 12:09:01,697 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/6/12 12:09 PM. Start running CanDoAction for command number 1/9 (Command type: RunVm) >2012-08-06 12:09:01,725 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-34) Lock Acquired to object EngineLock [exclusiveLocks= key: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 value: VM >, sharedLocks= ] >2012-08-06 12:09:01,742 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) Lock Acquired to object EngineLock [exclusiveLocks= key: 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3 value: VM >, sharedLocks= ] >2012-08-06 12:09:01,745 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-43) Lock Acquired to object EngineLock [exclusiveLocks= key: 6a8ef0f6-c139-41d9-a814-60ca51daa5f4 value: VM >, sharedLocks= ] >2012-08-06 12:09:01,767 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-47) Lock Acquired to object EngineLock [exclusiveLocks= key: 95b9258b-9b92-4b12-93fa-b5056b9176d9 value: VM >, sharedLocks= ] >2012-08-06 12:09:01,771 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) Lock Acquired to object EngineLock [exclusiveLocks= key: 3ee28762-5b38-409a-8e34-aebd1ed491f6 value: VM >, sharedLocks= ] >2012-08-06 12:09:01,781 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) Lock Acquired to object EngineLock [exclusiveLocks= key: de370719-d4d0-4299-93d6-2fc4a274aa28 value: VM >, sharedLocks= ] >2012-08-06 12:09:01,785 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) Lock Acquired to object EngineLock [exclusiveLocks= key: ad77ef63-994a-4f05-ae14-9488e891a059 value: VM >, sharedLocks= ] >2012-08-06 12:09:01,796 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-34) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 56f2ee99 >2012-08-06 12:09:01,801 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) Lock Acquired to object EngineLock [exclusiveLocks= key: 458adebd-ebe5-46f6-98a5-3359ab42f11b value: VM >, sharedLocks= ] >2012-08-06 12:09:01,807 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-34) FINISH, IsValidVDSCommand, return: true, log id: 56f2ee99 >2012-08-06 12:09:01,812 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 51b616d2 >2012-08-06 12:09:01,815 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4ce5ac0b >2012-08-06 12:09:01,817 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) FINISH, IsValidVDSCommand, return: true, log id: 4ce5ac0b >2012-08-06 12:09:01,830 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) FINISH, IsValidVDSCommand, return: true, log id: 51b616d2 >2012-08-06 12:09:01,864 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 17b752fd >2012-08-06 12:09:01,865 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) FINISH, IsValidVDSCommand, return: true, log id: 17b752fd >2012-08-06 12:09:01,877 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) Lock Acquired to object EngineLock [exclusiveLocks= key: a6c1ef37-5de7-403f-aecd-0185a55c3046 value: VM >, sharedLocks= ] >2012-08-06 12:09:01,888 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-47) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 7a82021 >2012-08-06 12:09:01,889 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-47) FINISH, IsValidVDSCommand, return: true, log id: 7a82021 >2012-08-06 12:09:01,907 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 19b9d655 >2012-08-06 12:09:01,913 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) FINISH, IsValidVDSCommand, return: true, log id: 19b9d655 >2012-08-06 12:09:01,945 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-43) START, IsVmDuringInitiatingVDSCommand(vmId = 6a8ef0f6-c139-41d9-a814-60ca51daa5f4), log id: 788ed1bb >2012-08-06 12:09:01,945 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-43) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 788ed1bb >2012-08-06 12:09:01,958 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/6/12 12:09 PM. Finish handling CanDoAction for command number 9/9 (Command type: RunVm) >2012-08-06 12:09:01,961 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-34) START, IsVmDuringInitiatingVDSCommand(vmId = 3c5452c9-a5e2-46af-90b5-b568da5dc3d4), log id: 68f1e3e >2012-08-06 12:09:01,962 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-34) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 68f1e3e >2012-08-06 12:09:01,963 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) START, IsVmDuringInitiatingVDSCommand(vmId = 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3), log id: 68a841bd >2012-08-06 12:09:01,971 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 68a841bd >2012-08-06 12:09:01,987 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-34) End time: 8/6/12 12:09 PM. Finish handling CanDoAction for command number 7/9 (Command type: RunVm) >2012-08-06 12:09:01,988 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/6/12 12:09 PM. Finish handling CanDoAction for command number 8/9 (Command type: RunVm) >2012-08-06 12:09:02,040 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-47) START, IsVmDuringInitiatingVDSCommand(vmId = 95b9258b-9b92-4b12-93fa-b5056b9176d9), log id: 6a509419 >2012-08-06 12:09:02,040 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-47) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 6a509419 >2012-08-06 12:09:02,051 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) START, IsVmDuringInitiatingVDSCommand(vmId = 3ee28762-5b38-409a-8e34-aebd1ed491f6), log id: 2c0d1051 >2012-08-06 12:09:02,052 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 2c0d1051 >2012-08-06 12:09:02,052 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-42) START, IsVmDuringInitiatingVDSCommand(vmId = de370719-d4d0-4299-93d6-2fc4a274aa28), log id: 2780126b >2012-08-06 12:09:02,054 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-42) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 2780126b >2012-08-06 12:09:02,062 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/6/12 12:09 PM. Finish handling CanDoAction for command number 6/9 (Command type: RunVm) >2012-08-06 12:09:02,064 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) End time: 8/6/12 12:09 PM. Finish handling CanDoAction for command number 4/9 (Command type: RunVm) >2012-08-06 12:09:02,068 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) End time: 8/6/12 12:09 PM. Finish handling CanDoAction for command number 5/9 (Command type: RunVm) >2012-08-06 12:09:02,086 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6462a9f6 >2012-08-06 12:09:02,087 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) FINISH, IsValidVDSCommand, return: true, log id: 6462a9f6 >2012-08-06 12:09:02,173 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) START, IsVmDuringInitiatingVDSCommand(vmId = ad77ef63-994a-4f05-ae14-9488e891a059), log id: 43b0f183 >2012-08-06 12:09:02,174 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 43b0f183 >2012-08-06 12:09:02,200 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/6/12 12:09 PM. Finish handling CanDoAction for command number 3/9 (Command type: RunVm) >2012-08-06 12:09:02,205 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 5d22d0d >2012-08-06 12:09:02,227 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) FINISH, IsValidVDSCommand, return: true, log id: 5d22d0d >2012-08-06 12:09:02,379 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) START, IsVmDuringInitiatingVDSCommand(vmId = 458adebd-ebe5-46f6-98a5-3359ab42f11b), log id: 75b09c46 >2012-08-06 12:09:02,380 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 75b09c46 >2012-08-06 12:09:02,440 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/6/12 12:09 PM. Finish handling CanDoAction for command number 1/9 (Command type: RunVm) >2012-08-06 12:09:02,704 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 75613bf3 >2012-08-06 12:09:02,706 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) FINISH, IsValidVDSCommand, return: true, log id: 75613bf3 >2012-08-06 12:09:02,969 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-48) START, IsVmDuringInitiatingVDSCommand(vmId = a6c1ef37-5de7-403f-aecd-0185a55c3046), log id: 3001ec1e >2012-08-06 12:09:02,970 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-48) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 3001ec1e >2012-08-06 12:09:02,987 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) End time: 8/6/12 12:09 PM. Finish handling CanDoAction for command number 2/9 (Command type: RunVm) >2012-08-06 12:09:03,068 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [51e0d429] Running command: RunVmCommand internal: false. Entities affected : ID: 6a8ef0f6-c139-41d9-a814-60ca51daa5f4 Type: VM >2012-08-06 12:09:03,257 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [51e0d429] Cant find VDS to run the VM 6a8ef0f6-c139-41d9-a814-60ca51daa5f4 on, so this VM will not be run. >2012-08-06 12:09:03,289 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [51e0d429] Lock freed to object EngineLock [exclusiveLocks= key: 6a8ef0f6-c139-41d9-a814-60ca51daa5f4 value: VM >, sharedLocks= ] >2012-08-06 12:09:03,514 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [4ef63741] Running command: RunVmCommand internal: false. Entities affected : ID: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 Type: VM >2012-08-06 12:09:03,524 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [4ef63741] Cant find VDS to run the VM 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 on, so this VM will not be run. >2012-08-06 12:09:03,555 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [4ef63741] Lock freed to object EngineLock [exclusiveLocks= key: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 value: VM >, sharedLocks= ] >2012-08-06 12:09:03,735 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [7f5db809] Running command: RunVmCommand internal: false. Entities affected : ID: 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3 Type: VM >2012-08-06 12:09:03,792 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [7f5db809] Cant find VDS to run the VM 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3 on, so this VM will not be run. >2012-08-06 12:09:03,828 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [7f5db809] Lock freed to object EngineLock [exclusiveLocks= key: 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3 value: VM >, sharedLocks= ] >2012-08-06 12:09:03,926 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [751011cf] Running command: RunVmCommand internal: false. Entities affected : ID: 458adebd-ebe5-46f6-98a5-3359ab42f11b Type: VM >2012-08-06 12:09:03,935 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [751011cf] Cant find VDS to run the VM 458adebd-ebe5-46f6-98a5-3359ab42f11b on, so this VM will not be run. >2012-08-06 12:09:03,956 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [751011cf] Lock freed to object EngineLock [exclusiveLocks= key: 458adebd-ebe5-46f6-98a5-3359ab42f11b value: VM >, sharedLocks= ] >2012-08-06 12:09:04,096 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [5238858] Running command: RunVmCommand internal: false. Entities affected : ID: a6c1ef37-5de7-403f-aecd-0185a55c3046 Type: VM >2012-08-06 12:09:04,138 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [5238858] Cant find VDS to run the VM a6c1ef37-5de7-403f-aecd-0185a55c3046 on, so this VM will not be run. >2012-08-06 12:09:04,165 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [5238858] Lock freed to object EngineLock [exclusiveLocks= key: a6c1ef37-5de7-403f-aecd-0185a55c3046 value: VM >, sharedLocks= ] >2012-08-06 12:09:04,259 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [5eff00ec] Running command: RunVmCommand internal: false. Entities affected : ID: ad77ef63-994a-4f05-ae14-9488e891a059 Type: VM >2012-08-06 12:09:04,268 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [5eff00ec] Cant find VDS to run the VM ad77ef63-994a-4f05-ae14-9488e891a059 on, so this VM will not be run. >2012-08-06 12:09:04,285 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [5eff00ec] Lock freed to object EngineLock [exclusiveLocks= key: ad77ef63-994a-4f05-ae14-9488e891a059 value: VM >, sharedLocks= ] >2012-08-06 12:09:04,405 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [32b1c3c2] Running command: RunVmCommand internal: false. Entities affected : ID: de370719-d4d0-4299-93d6-2fc4a274aa28 Type: VM >2012-08-06 12:09:04,413 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [32b1c3c2] Cant find VDS to run the VM de370719-d4d0-4299-93d6-2fc4a274aa28 on, so this VM will not be run. >2012-08-06 12:09:04,431 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [32b1c3c2] Lock freed to object EngineLock [exclusiveLocks= key: de370719-d4d0-4299-93d6-2fc4a274aa28 value: VM >, sharedLocks= ] >2012-08-06 12:09:04,567 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [4c3122cf] Running command: RunVmCommand internal: false. Entities affected : ID: 3ee28762-5b38-409a-8e34-aebd1ed491f6 Type: VM >2012-08-06 12:09:04,576 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [4c3122cf] Cant find VDS to run the VM 3ee28762-5b38-409a-8e34-aebd1ed491f6 on, so this VM will not be run. >2012-08-06 12:09:04,602 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [4c3122cf] Lock freed to object EngineLock [exclusiveLocks= key: 3ee28762-5b38-409a-8e34-aebd1ed491f6 value: VM >, sharedLocks= ] >2012-08-06 12:09:04,686 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [7c260423] Running command: RunVmCommand internal: false. Entities affected : ID: 95b9258b-9b92-4b12-93fa-b5056b9176d9 Type: VM >2012-08-06 12:09:04,695 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [7c260423] Cant find VDS to run the VM 95b9258b-9b92-4b12-93fa-b5056b9176d9 on, so this VM will not be run. >2012-08-06 12:09:04,850 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [7c260423] Lock freed to object EngineLock [exclusiveLocks= key: 95b9258b-9b92-4b12-93fa-b5056b9176d9 value: VM >, sharedLocks= ] >2012-08-06 12:09:55,953 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-27) DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 12:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable hosts >2012-08-06 12:10:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Autorecovering 0 hosts >2012-08-06 12:10:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable hosts done >2012-08-06 12:10:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable storage domains >2012-08-06 12:10:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Autorecovering 0 storage domains >2012-08-06 12:10:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable storage domains done >2012-08-06 12:10:06,208 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/6/12 12:10 PM. Start running CanDoAction for command number 1/2 (Command type: RunVm) >2012-08-06 12:10:06,209 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) Start time: 8/6/12 12:10 PM. Start running CanDoAction for command number 2/2 (Command type: RunVm) >2012-08-06 12:10:06,218 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) Lock Acquired to object EngineLock [exclusiveLocks= key: 3ee28762-5b38-409a-8e34-aebd1ed491f6 value: VM >, sharedLocks= ] >2012-08-06 12:10:06,223 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) Lock Acquired to object EngineLock [exclusiveLocks= key: de370719-d4d0-4299-93d6-2fc4a274aa28 value: VM >, sharedLocks= ] >2012-08-06 12:10:06,234 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1700fe20 >2012-08-06 12:10:06,236 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) FINISH, IsValidVDSCommand, return: true, log id: 1700fe20 >2012-08-06 12:10:06,240 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 314555ed >2012-08-06 12:10:06,242 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) FINISH, IsValidVDSCommand, return: true, log id: 314555ed >2012-08-06 12:10:06,313 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) START, IsVmDuringInitiatingVDSCommand(vmId = 3ee28762-5b38-409a-8e34-aebd1ed491f6), log id: 53ffe648 >2012-08-06 12:10:06,314 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 53ffe648 >2012-08-06 12:10:06,319 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/6/12 12:10 PM. Finish handling CanDoAction for command number 1/2 (Command type: RunVm) >2012-08-06 12:10:06,331 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-48) START, IsVmDuringInitiatingVDSCommand(vmId = de370719-d4d0-4299-93d6-2fc4a274aa28), log id: 5b3052f8 >2012-08-06 12:10:06,331 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-48) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 5b3052f8 >2012-08-06 12:10:06,341 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) End time: 8/6/12 12:10 PM. Finish handling CanDoAction for command number 2/2 (Command type: RunVm) >2012-08-06 12:10:06,407 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [4cdf7bed] Running command: RunVmCommand internal: false. Entities affected : ID: de370719-d4d0-4299-93d6-2fc4a274aa28 Type: VM >2012-08-06 12:10:06,415 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [4cdf7bed] Cant find VDS to run the VM de370719-d4d0-4299-93d6-2fc4a274aa28 on, so this VM will not be run. >2012-08-06 12:10:06,440 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [4cdf7bed] Lock freed to object EngineLock [exclusiveLocks= key: de370719-d4d0-4299-93d6-2fc4a274aa28 value: VM >, sharedLocks= ] >2012-08-06 12:10:06,570 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [22444034] Running command: RunVmCommand internal: false. Entities affected : ID: 3ee28762-5b38-409a-8e34-aebd1ed491f6 Type: VM >2012-08-06 12:10:06,579 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [22444034] Cant find VDS to run the VM 3ee28762-5b38-409a-8e34-aebd1ed491f6 on, so this VM will not be run. >2012-08-06 12:10:06,593 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [22444034] Lock freed to object EngineLock [exclusiveLocks= key: 3ee28762-5b38-409a-8e34-aebd1ed491f6 value: VM >, sharedLocks= ] >2012-08-06 12:10:17,720 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8009-8) Lock Acquired to object EngineLock [exclusiveLocks= key: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 value: VM >, sharedLocks= ] >2012-08-06 12:10:17,729 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-8) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 23052a9f >2012-08-06 12:10:17,730 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-8) FINISH, IsValidVDSCommand, return: true, log id: 23052a9f >2012-08-06 12:10:17,783 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-8) START, IsVmDuringInitiatingVDSCommand(vmId = 3c5452c9-a5e2-46af-90b5-b568da5dc3d4), log id: 74cffb3e >2012-08-06 12:10:17,785 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-8) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 74cffb3e >2012-08-06 12:10:17,869 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [18d0c9e] Running command: RunVmCommand internal: false. Entities affected : ID: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 Type: VM >2012-08-06 12:10:17,878 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [18d0c9e] Cant find VDS to run the VM 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 on, so this VM will not be run. >2012-08-06 12:10:17,894 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [18d0c9e] Lock freed to object EngineLock [exclusiveLocks= key: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 value: VM >, sharedLocks= ] >2012-08-06 12:10:26,603 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8009-12) Lock Acquired to object EngineLock [exclusiveLocks= key: ba81adbe-b311-4aef-b6c1-5f84f0f3c94d value: VM >, sharedLocks= ] >2012-08-06 12:10:26,609 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-12) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4910ea36 >2012-08-06 12:10:26,611 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-12) FINISH, IsValidVDSCommand, return: true, log id: 4910ea36 >2012-08-06 12:10:26,643 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-12) START, IsVmDuringInitiatingVDSCommand(vmId = ba81adbe-b311-4aef-b6c1-5f84f0f3c94d), log id: 26a2a41d >2012-08-06 12:10:26,643 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-12) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 26a2a41d >2012-08-06 12:10:26,775 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [733f3b7f] Running command: RunVmCommand internal: false. Entities affected : ID: ba81adbe-b311-4aef-b6c1-5f84f0f3c94d Type: VM >2012-08-06 12:10:26,783 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [733f3b7f] Cant find VDS to run the VM ba81adbe-b311-4aef-b6c1-5f84f0f3c94d on, so this VM will not be run. >2012-08-06 12:10:26,818 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [733f3b7f] Lock freed to object EngineLock [exclusiveLocks= key: ba81adbe-b311-4aef-b6c1-5f84f0f3c94d value: VM >, sharedLocks= ] >2012-08-06 12:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable hosts >2012-08-06 12:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Autorecovering 0 hosts >2012-08-06 12:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable hosts done >2012-08-06 12:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable storage domains >2012-08-06 12:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Autorecovering 0 storage domains >2012-08-06 12:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable storage domains done >2012-08-06 12:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable hosts >2012-08-06 12:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Autorecovering 0 hosts >2012-08-06 12:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable hosts done >2012-08-06 12:20:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable storage domains >2012-08-06 12:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Autorecovering 0 storage domains >2012-08-06 12:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable storage domains done >2012-08-06 12:23:41,321 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8009-3) Lock Acquired to object EngineLock [exclusiveLocks= key: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 value: VM >, sharedLocks= ] >2012-08-06 12:23:41,328 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-3) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 56971a48 >2012-08-06 12:23:41,329 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-3) FINISH, IsValidVDSCommand, return: true, log id: 56971a48 >2012-08-06 12:23:41,367 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-3) START, IsVmDuringInitiatingVDSCommand(vmId = 3c5452c9-a5e2-46af-90b5-b568da5dc3d4), log id: 6eb769a >2012-08-06 12:23:41,368 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-3) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 6eb769a >2012-08-06 12:23:41,470 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [72c341c2] Running command: RunVmCommand internal: false. Entities affected : ID: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 Type: VM >2012-08-06 12:23:41,480 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [72c341c2] Cant find VDS to run the VM 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 on, so this VM will not be run. >2012-08-06 12:23:41,509 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [72c341c2] Lock freed to object EngineLock [exclusiveLocks= key: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 value: VM >, sharedLocks= ] >2012-08-06 12:24:14,296 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8009-12) Lock Acquired to object EngineLock [exclusiveLocks= key: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 value: VM >, sharedLocks= ] >2012-08-06 12:24:14,302 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-12) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 566723f >2012-08-06 12:24:14,304 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-12) FINISH, IsValidVDSCommand, return: true, log id: 566723f >2012-08-06 12:24:14,403 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-12) START, IsVmDuringInitiatingVDSCommand(vmId = 3c5452c9-a5e2-46af-90b5-b568da5dc3d4), log id: 3801829a >2012-08-06 12:24:14,404 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-12) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 3801829a >2012-08-06 12:24:14,469 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [38fbf84e] Running command: RunVmCommand internal: false. Entities affected : ID: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 Type: VM >2012-08-06 12:24:14,477 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [38fbf84e] Cant find VDS to run the VM 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 on, so this VM will not be run. >2012-08-06 12:24:14,491 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [38fbf84e] Lock freed to object EngineLock [exclusiveLocks= key: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 value: VM >, sharedLocks= ] >2012-08-06 12:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable hosts >2012-08-06 12:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Autorecovering 0 hosts >2012-08-06 12:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable hosts done >2012-08-06 12:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable storage domains >2012-08-06 12:25:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Autorecovering 0 storage domains >2012-08-06 12:25:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable storage domains done >2012-08-06 12:25:20,596 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8009-7) [23a16d96] Lock Acquired to object EngineLock [exclusiveLocks= key: lesik value: VM_NAME >, sharedLocks= ] >2012-08-06 12:25:20,627 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-7) [23a16d96] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: e2233cf >2012-08-06 12:25:20,630 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-7) [23a16d96] FINISH, IsValidVDSCommand, return: true, log id: e2233cf >2012-08-06 12:25:20,682 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8009-7) [23a16d96] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups >2012-08-06 12:25:20,688 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-7) [23a16d96] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 19c2e033 >2012-08-06 12:25:20,693 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-7) [23a16d96] FINISH, IsValidVDSCommand, return: true, log id: 19c2e033 >2012-08-06 12:25:20,770 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8009-7) [23a16d96] Lock freed to object EngineLock [exclusiveLocks= key: lesik value: VM_NAME >, sharedLocks= ] >2012-08-06 12:25:23,017 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp--127.0.0.1-8009-8) [41110cf2] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 Type: VM >2012-08-06 12:25:23,018 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp--127.0.0.1-8009-8) [41110cf2] MacPoolManager::allocateNewMac entered >2012-08-06 12:25:23,021 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp--127.0.0.1-8009-8) [41110cf2] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:71 >2012-08-06 12:25:24,738 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-11) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 36ccf50a >2012-08-06 12:25:25,662 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-11) FINISH, GetDeviceListVDSCommand, return: [], log id: 36ccf50a >2012-08-06 12:25:29,087 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-7) START, GetDeviceListVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storageType=ISCSI), log id: 13af81b4 >2012-08-06 12:25:31,235 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-7) FINISH, GetDeviceListVDSCommand, return: [], log id: 13af81b4 >2012-08-06 12:25:33,080 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8009-12) [5c5493b6] Lock Acquired to object EngineLock [exclusiveLocks= key: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 value: VM_DISK_BOOT >, sharedLocks= key: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 value: VM >] >2012-08-06 12:25:33,095 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-12) [5c5493b6] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 2ff76ae4 >2012-08-06 12:25:33,102 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-12) [5c5493b6] FINISH, IsValidVDSCommand, return: true, log id: 2ff76ae4 >2012-08-06 12:25:33,131 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8009-12) [5c5493b6] Running command: AddDiskCommand internal: false. Entities affected : ID: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 Type: VM, ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 12:25:33,557 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp--127.0.0.1-8009-12) [300c6cc2] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 12:25:33,792 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp--127.0.0.1-8009-12) [300c6cc2] Lock freed to object EngineLock [exclusiveLocks= key: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 value: VM_DISK_BOOT >, sharedLocks= key: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 value: VM >] >2012-08-06 12:25:33,795 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp--127.0.0.1-8009-12) [300c6cc2] START, CreateImageVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = d2327447-d863-4b44-97cb-2aa7bedec3b1, imageSizeInBytes = 1073741824, volumeFormat = RAW, newImageId = b9235c9a-55a5-4b39-aff6-d88df54ba9b5, newImageDescription = ), log id: 2ba56cce >2012-08-06 12:25:33,805 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp--127.0.0.1-8009-12) [300c6cc2] -- CreateImageVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 12:25:33,809 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp--127.0.0.1-8009-12) [300c6cc2] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=d2327447-d863-4b44-97cb-2aa7bedec3b1 > size=1,073,741,824 bytes > volFormat=RAW > volType=Sparse > volUUID=b9235c9a-55a5-4b39-aff6-d88df54ba9b5 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2012-08-06 12:25:33,951 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp--127.0.0.1-8009-12) [300c6cc2] FINISH, CreateImageVDSCommand, return: b9235c9a-55a5-4b39-aff6-d88df54ba9b5, log id: 2ba56cce >2012-08-06 12:25:34,086 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (ajp--127.0.0.1-8009-12) [300c6cc2] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity d2327447-d863-4b44-97cb-2aa7bedec3b1 >2012-08-06 12:25:34,090 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (ajp--127.0.0.1-8009-12) [300c6cc2] EntityMultiAsyncTasks::AttachTask: Attaching task 20908faa-50bc-4396-87ad-be9fdf57ec55 to entity d2327447-d863-4b44-97cb-2aa7bedec3b1. >2012-08-06 12:25:34,096 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (ajp--127.0.0.1-8009-12) [300c6cc2] Adding task 20908faa-50bc-4396-87ad-be9fdf57ec55 to DataBase >2012-08-06 12:25:34,167 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp--127.0.0.1-8009-12) [300c6cc2] Adding task 20908faa-50bc-4396-87ad-be9fdf57ec55 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 12:25:34,613 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp--127.0.0.1-8009-12) [300c6cc2] BaseAsyncTask::StartPollingTask: Starting to poll task 20908faa-50bc-4396-87ad-be9fdf57ec55. >2012-08-06 12:25:34,614 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (ajp--127.0.0.1-8009-12) [300c6cc2] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity d2327447-d863-4b44-97cb-2aa7bedec3b1 is AddDisk (determined by task 20908faa-50bc-4396-87ad-be9fdf57ec55) >2012-08-06 12:25:40,569 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-7) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2012-08-06 12:25:40,593 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-7) SPMAsyncTask::PollTask: Polling task 20908faa-50bc-4396-87ad-be9fdf57ec55 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 12:25:40,624 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-7) BaseAsyncTask::OnTaskEndSuccess: Task 20908faa-50bc-4396-87ad-be9fdf57ec55 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 12:25:40,630 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-7) EntityAsyncTask::EndActionIfNecessary: All tasks of entity d2327447-d863-4b44-97cb-2aa7bedec3b1 has ended -> executing EndAction >2012-08-06 12:25:40,634 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-7) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: d2327447-d863-4b44-97cb-2aa7bedec3b1): calling EndAction for action type AddDisk. >2012-08-06 12:25:40,638 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddDisk >2012-08-06 12:25:40,671 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-3-thread-48) [5c5493b6] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2012-08-06 12:25:40,675 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-48) [300c6cc2] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2012-08-06 12:25:40,686 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [300c6cc2] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = d2327447-d863-4b44-97cb-2aa7bedec3b1, imageId = b9235c9a-55a5-4b39-aff6-d88df54ba9b5), log id: 716cdb63 >2012-08-06 12:25:40,745 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [300c6cc2] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@5aa4d8f9, log id: 716cdb63 >2012-08-06 12:25:40,780 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-48) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 61a9f473 >2012-08-06 12:25:40,835 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-48) FINISH, UpdateVMVDSCommand, log id: 61a9f473 >2012-08-06 12:25:40,884 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk completed, handling the result. >2012-08-06 12:25:40,885 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk succeeded, clearing tasks. >2012-08-06 12:25:40,911 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 20908faa-50bc-4396-87ad-be9fdf57ec55 >2012-08-06 12:25:40,912 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-48) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 20908faa-50bc-4396-87ad-be9fdf57ec55), log id: a4b5118 >2012-08-06 12:25:40,915 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-48) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=20908faa-50bc-4396-87ad-be9fdf57ec55), log id: 2d91e2a >2012-08-06 12:25:40,953 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 2d91e2a >2012-08-06 12:25:40,954 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-48) FINISH, SPMClearTaskVDSCommand, log id: a4b5118 >2012-08-06 12:25:40,968 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task 20908faa-50bc-4396-87ad-be9fdf57ec55 from DataBase >2012-08-06 12:25:40,969 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity d2327447-d863-4b44-97cb-2aa7bedec3b1 >2012-08-06 12:25:46,554 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8009-9) Lock Acquired to object EngineLock [exclusiveLocks= key: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 value: VM >, sharedLocks= ] >2012-08-06 12:25:46,561 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-9) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1ae9b926 >2012-08-06 12:25:46,565 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-9) FINISH, IsValidVDSCommand, return: true, log id: 1ae9b926 >2012-08-06 12:25:46,598 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-9) START, IsVmDuringInitiatingVDSCommand(vmId = 54b872c6-cefc-4a19-b48e-9bc1a09285f9), log id: 1eb10eec >2012-08-06 12:25:46,599 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-9) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 1eb10eec >2012-08-06 12:25:46,690 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [1c7585c7] Running command: RunVmCommand internal: false. Entities affected : ID: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 Type: VM >2012-08-06 12:25:46,704 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [1c7585c7] Cant find VDS to run the VM 54b872c6-cefc-4a19-b48e-9bc1a09285f9 on, so this VM will not be run. >2012-08-06 12:25:46,716 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [1c7585c7] Lock freed to object EngineLock [exclusiveLocks= key: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 value: VM >, sharedLocks= ] >2012-08-06 12:26:29,673 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 1/10 (Command type: RemoveVmFromPool) >2012-08-06 12:26:29,678 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 2/10 (Command type: RemoveVmFromPool) >2012-08-06 12:26:29,685 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 3/10 (Command type: RemoveVmFromPool) >2012-08-06 12:26:29,691 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 4/10 (Command type: RemoveVmFromPool) >2012-08-06 12:26:29,697 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 5/10 (Command type: RemoveVmFromPool) >2012-08-06 12:26:29,702 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 6/10 (Command type: RemoveVmFromPool) >2012-08-06 12:26:29,707 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 7/10 (Command type: RemoveVmFromPool) >2012-08-06 12:26:29,713 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-34) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 8/10 (Command type: RemoveVmFromPool) >2012-08-06 12:26:29,718 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 9/10 (Command type: RemoveVmFromPool) >2012-08-06 12:26:29,723 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 10/10 (Command type: RemoveVmFromPool) >2012-08-06 12:26:29,998 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 2/10 (Command type: RemoveVmFromPool) >2012-08-06 12:26:30,061 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 3/10 (Command type: RemoveVmFromPool) >2012-08-06 12:26:30,073 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 9/10 (Command type: RemoveVmFromPool) >2012-08-06 12:26:30,074 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 1/10 (Command type: RemoveVmFromPool) >2012-08-06 12:26:30,074 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 4/10 (Command type: RemoveVmFromPool) >2012-08-06 12:26:30,089 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 10/10 (Command type: RemoveVmFromPool) >2012-08-06 12:26:30,094 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 5/10 (Command type: RemoveVmFromPool) >2012-08-06 12:26:30,096 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-34) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 8/10 (Command type: RemoveVmFromPool) >2012-08-06 12:26:30,098 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 7/10 (Command type: RemoveVmFromPool) >2012-08-06 12:26:30,101 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 6/10 (Command type: RemoveVmFromPool) >2012-08-06 12:26:30,102 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 12/15 (Command type: RemoveVmFromPool) >2012-08-06 12:26:30,103 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-34) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 13/15 (Command type: RemoveVmFromPool) >2012-08-06 12:26:30,104 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 14/15 (Command type: RemoveVmFromPool) >2012-08-06 12:26:30,105 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 15/15 (Command type: RemoveVmFromPool) >2012-08-06 12:26:30,106 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 11/15 (Command type: RemoveVmFromPool) >2012-08-06 12:26:30,145 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 14/15 (Command type: RemoveVmFromPool) >2012-08-06 12:26:30,147 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 12/15 (Command type: RemoveVmFromPool) >2012-08-06 12:26:30,148 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 15/15 (Command type: RemoveVmFromPool) >2012-08-06 12:26:30,150 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-34) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 13/15 (Command type: RemoveVmFromPool) >2012-08-06 12:26:30,154 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 11/15 (Command type: RemoveVmFromPool) >2012-08-06 12:26:30,156 INFO [org.ovirt.engine.core.bll.RemoveVmFromPoolCommand] (pool-3-thread-47) [2a79eb9d] Running command: RemoveVmFromPoolCommand internal: false. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 12:26:30,223 INFO [org.ovirt.engine.core.bll.RemoveVmFromPoolCommand] (pool-3-thread-47) [a92bdb7] Running command: RemoveVmFromPoolCommand internal: false. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 12:26:30,256 INFO [org.ovirt.engine.core.bll.RemoveVmFromPoolCommand] (pool-3-thread-47) [3a34267e] Running command: RemoveVmFromPoolCommand internal: false. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 12:26:30,289 INFO [org.ovirt.engine.core.bll.RemoveVmFromPoolCommand] (pool-3-thread-47) [5c242d63] Running command: RemoveVmFromPoolCommand internal: false. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 12:26:30,323 INFO [org.ovirt.engine.core.bll.RemoveVmFromPoolCommand] (pool-3-thread-47) [7f51ceb8] Running command: RemoveVmFromPoolCommand internal: false. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 12:26:30,401 INFO [org.ovirt.engine.core.bll.RemoveVmFromPoolCommand] (pool-3-thread-47) [575d6b1b] Running command: RemoveVmFromPoolCommand internal: false. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 12:26:30,450 INFO [org.ovirt.engine.core.bll.RemoveVmFromPoolCommand] (pool-3-thread-47) [3681bd5d] Running command: RemoveVmFromPoolCommand internal: false. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 12:26:30,484 INFO [org.ovirt.engine.core.bll.RemoveVmFromPoolCommand] (pool-3-thread-47) [13ea4fb4] Running command: RemoveVmFromPoolCommand internal: false. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 12:26:30,526 INFO [org.ovirt.engine.core.bll.RemoveVmFromPoolCommand] (pool-3-thread-47) [6b93dade] Running command: RemoveVmFromPoolCommand internal: false. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 12:26:30,569 INFO [org.ovirt.engine.core.bll.RemoveVmFromPoolCommand] (pool-3-thread-47) [50d178e5] Running command: RemoveVmFromPoolCommand internal: false. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 12:26:30,613 INFO [org.ovirt.engine.core.bll.RemoveVmFromPoolCommand] (pool-3-thread-47) [1502cc3d] Running command: RemoveVmFromPoolCommand internal: false. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 12:26:30,664 INFO [org.ovirt.engine.core.bll.RemoveVmFromPoolCommand] (pool-3-thread-47) [56cc5a81] Running command: RemoveVmFromPoolCommand internal: false. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 12:26:30,696 INFO [org.ovirt.engine.core.bll.RemoveVmFromPoolCommand] (pool-3-thread-47) [30c94364] Running command: RemoveVmFromPoolCommand internal: false. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 12:26:30,766 INFO [org.ovirt.engine.core.bll.RemoveVmFromPoolCommand] (pool-3-thread-47) [5441f22d] Running command: RemoveVmFromPoolCommand internal: false. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 12:26:30,838 INFO [org.ovirt.engine.core.bll.RemoveVmFromPoolCommand] (pool-3-thread-47) [7ca1e660] Running command: RemoveVmFromPoolCommand internal: false. Entities affected : ID: 863fc580-dfa4-11e1-ba65-63667a875b75 Type: VmPool >2012-08-06 12:26:36,926 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8009-5) Lock Acquired to object EngineLock [exclusiveLocks= key: ad77ef63-994a-4f05-ae14-9488e891a059 value: VM >, sharedLocks= ] >2012-08-06 12:26:36,938 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-5) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4dbde5fe >2012-08-06 12:26:36,939 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-5) FINISH, IsValidVDSCommand, return: true, log id: 4dbde5fe >2012-08-06 12:26:36,973 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-5) START, IsVmDuringInitiatingVDSCommand(vmId = ad77ef63-994a-4f05-ae14-9488e891a059), log id: b184f24 >2012-08-06 12:26:36,974 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-5) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: b184f24 >2012-08-06 12:26:37,057 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-47) [56443b47] Running command: RunVmCommand internal: false. Entities affected : ID: ad77ef63-994a-4f05-ae14-9488e891a059 Type: VM >2012-08-06 12:26:37,066 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-47) [56443b47] Cant find VDS to run the VM ad77ef63-994a-4f05-ae14-9488e891a059 on, so this VM will not be run. >2012-08-06 12:26:37,089 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-47) [56443b47] Lock freed to object EngineLock [exclusiveLocks= key: ad77ef63-994a-4f05-ae14-9488e891a059 value: VM >, sharedLocks= ] >2012-08-06 12:26:44,729 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-34) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 1/8 (Command type: RemoveVm) >2012-08-06 12:26:44,731 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 8/8 (Command type: RemoveVm) >2012-08-06 12:26:44,731 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 7/8 (Command type: RemoveVm) >2012-08-06 12:26:44,731 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 6/8 (Command type: RemoveVm) >2012-08-06 12:26:44,731 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 5/8 (Command type: RemoveVm) >2012-08-06 12:26:44,730 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 2/8 (Command type: RemoveVm) >2012-08-06 12:26:44,730 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 4/8 (Command type: RemoveVm) >2012-08-06 12:26:44,730 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 3/8 (Command type: RemoveVm) >2012-08-06 12:26:44,768 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-46) Lock Acquired to object EngineLock [exclusiveLocks= key: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 value: VM >, sharedLocks= ] >2012-08-06 12:26:44,771 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-44) Lock Acquired to object EngineLock [exclusiveLocks= key: ad77ef63-994a-4f05-ae14-9488e891a059 value: VM >, sharedLocks= ] >2012-08-06 12:26:44,771 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-49) Lock Acquired to object EngineLock [exclusiveLocks= key: 95b9258b-9b92-4b12-93fa-b5056b9176d9 value: VM >, sharedLocks= ] >2012-08-06 12:26:44,778 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-43) Lock Acquired to object EngineLock [exclusiveLocks= key: 6a8ef0f6-c139-41d9-a814-60ca51daa5f4 value: VM >, sharedLocks= ] >2012-08-06 12:26:44,782 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) Lock Acquired to object EngineLock [exclusiveLocks= key: a6c1ef37-5de7-403f-aecd-0185a55c3046 value: VM >, sharedLocks= ] >2012-08-06 12:26:44,784 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-50) Lock Acquired to object EngineLock [exclusiveLocks= key: de370719-d4d0-4299-93d6-2fc4a274aa28 value: VM >, sharedLocks= ] >2012-08-06 12:26:44,790 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-42) Lock Acquired to object EngineLock [exclusiveLocks= key: 3ee28762-5b38-409a-8e34-aebd1ed491f6 value: VM >, sharedLocks= ] >2012-08-06 12:26:44,818 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-34) Lock Acquired to object EngineLock [exclusiveLocks= key: 458adebd-ebe5-46f6-98a5-3359ab42f11b value: VM >, sharedLocks= ] >2012-08-06 12:26:44,860 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 77ad3722 >2012-08-06 12:26:44,871 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-44) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 439a8070 >2012-08-06 12:26:44,873 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-44) FINISH, IsValidVDSCommand, return: true, log id: 439a8070 >2012-08-06 12:26:44,889 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) FINISH, IsValidVDSCommand, return: true, log id: 77ad3722 >2012-08-06 12:26:44,904 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: e711a55 >2012-08-06 12:26:44,907 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) FINISH, IsValidVDSCommand, return: true, log id: e711a55 >2012-08-06 12:26:44,944 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 3/8 (Command type: RemoveVm) >2012-08-06 12:26:45,256 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 8/8 (Command type: RemoveVm) >2012-08-06 12:26:45,257 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 6/8 (Command type: RemoveVm) >2012-08-06 12:26:45,259 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 48a1f334 >2012-08-06 12:26:45,262 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: bd57f00 >2012-08-06 12:26:45,262 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-34) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 30a0b733 >2012-08-06 12:26:45,273 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-34) FINISH, IsValidVDSCommand, return: true, log id: 30a0b733 >2012-08-06 12:26:45,278 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) FINISH, IsValidVDSCommand, return: true, log id: bd57f00 >2012-08-06 12:26:45,299 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) FINISH, IsValidVDSCommand, return: true, log id: 48a1f334 >2012-08-06 12:26:45,314 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-34) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 1/8 (Command type: RemoveVm) >2012-08-06 12:26:45,361 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 7/8 (Command type: RemoveVm) >2012-08-06 12:26:45,445 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 4/8 (Command type: RemoveVm) >2012-08-06 12:26:47,250 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 5a97fb0f >2012-08-06 12:26:47,266 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) FINISH, IsValidVDSCommand, return: true, log id: 5a97fb0f >2012-08-06 12:26:47,299 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 5/8 (Command type: RemoveVm) >2012-08-06 12:26:47,546 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-47) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1689d78a >2012-08-06 12:26:47,566 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-47) FINISH, IsValidVDSCommand, return: true, log id: 1689d78a >2012-08-06 12:26:47,606 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 2/8 (Command type: RemoveVm) >2012-08-06 12:26:47,721 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) [5651f3fd] Running command: RemoveVmCommand internal: false. Entities affected : ID: 458adebd-ebe5-46f6-98a5-3359ab42f11b Type: VM >2012-08-06 12:26:47,723 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) [5651f3fd] START, SetVmStatusVDSCommand(vmId = 458adebd-ebe5-46f6-98a5-3359ab42f11b, status = ImageLocked), log id: 353ad8d0 >2012-08-06 12:26:47,734 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) [5651f3fd] FINISH, SetVmStatusVDSCommand, log id: 353ad8d0 >2012-08-06 12:26:47,754 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) [5651f3fd] Lock freed to object EngineLock [exclusiveLocks= key: 458adebd-ebe5-46f6-98a5-3359ab42f11b value: VM >, sharedLocks= ] >2012-08-06 12:26:47,755 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-47) [5651f3fd] START, RemoveVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = 458adebd-ebe5-46f6-98a5-3359ab42f11b), log id: 6195ad35 >2012-08-06 12:26:47,815 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-47) [5651f3fd] FINISH, RemoveVMVDSCommand, log id: 6195ad35 >2012-08-06 12:26:47,822 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-3-thread-47) [299ea4a0] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: 458adebd-ebe5-46f6-98a5-3359ab42f11b Type: VM >2012-08-06 12:26:47,842 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-3-thread-47) [1855d357] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 12:26:47,864 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-47) [1855d357] START, DeleteImageGroupVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0fcdc02a-488a-4750-8eb4-a3c0aa5e5dd6, postZeros = false, forceDelete = false), log id: 43a4c264 >2012-08-06 12:26:48,213 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-47) [1855d357] FINISH, DeleteImageGroupVDSCommand, log id: 43a4c264 >2012-08-06 12:26:48,238 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) [1855d357] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 458adebd-ebe5-46f6-98a5-3359ab42f11b >2012-08-06 12:26:48,242 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-47) [1855d357] EntityMultiAsyncTasks::AttachTask: Attaching task 1299a8f1-3bc9-4dbf-ba62-c1448f786169 to entity 458adebd-ebe5-46f6-98a5-3359ab42f11b. >2012-08-06 12:26:48,246 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-47) [1855d357] Adding task 1299a8f1-3bc9-4dbf-ba62-c1448f786169 to DataBase >2012-08-06 12:26:48,271 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-47) [1855d357] Adding task 1299a8f1-3bc9-4dbf-ba62-c1448f786169 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 12:26:48,405 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) [1855d357] BaseAsyncTask::StartPollingTask: Starting to poll task 1299a8f1-3bc9-4dbf-ba62-c1448f786169. >2012-08-06 12:26:48,406 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-47) [1855d357] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 458adebd-ebe5-46f6-98a5-3359ab42f11b is RemoveVm (determined by task 1299a8f1-3bc9-4dbf-ba62-c1448f786169) >2012-08-06 12:26:48,536 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) [1e699351] Running command: RemoveVmCommand internal: false. Entities affected : ID: a6c1ef37-5de7-403f-aecd-0185a55c3046 Type: VM >2012-08-06 12:26:48,541 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) [1e699351] START, SetVmStatusVDSCommand(vmId = a6c1ef37-5de7-403f-aecd-0185a55c3046, status = ImageLocked), log id: 64bf39d2 >2012-08-06 12:26:48,547 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) [1e699351] FINISH, SetVmStatusVDSCommand, log id: 64bf39d2 >2012-08-06 12:26:48,570 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) [1e699351] Lock freed to object EngineLock [exclusiveLocks= key: a6c1ef37-5de7-403f-aecd-0185a55c3046 value: VM >, sharedLocks= ] >2012-08-06 12:26:48,573 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-47) [1e699351] START, RemoveVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = a6c1ef37-5de7-403f-aecd-0185a55c3046), log id: 7efcc546 >2012-08-06 12:26:48,622 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-47) [1e699351] FINISH, RemoveVMVDSCommand, log id: 7efcc546 >2012-08-06 12:26:48,626 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-3-thread-47) [39ca77] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: a6c1ef37-5de7-403f-aecd-0185a55c3046 Type: VM >2012-08-06 12:26:48,636 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-3-thread-47) [3421cc4] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 12:26:48,661 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-47) [3421cc4] START, DeleteImageGroupVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 102250e3-631d-4789-8be8-bdd53b4cf9d0, postZeros = false, forceDelete = false), log id: c16a184 >2012-08-06 12:26:49,109 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-47) [3421cc4] FINISH, DeleteImageGroupVDSCommand, log id: c16a184 >2012-08-06 12:26:49,134 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) [3421cc4] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity a6c1ef37-5de7-403f-aecd-0185a55c3046 >2012-08-06 12:26:49,138 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-47) [3421cc4] EntityMultiAsyncTasks::AttachTask: Attaching task b39ffee3-0ba7-46af-9137-187bf7aefd5e to entity a6c1ef37-5de7-403f-aecd-0185a55c3046. >2012-08-06 12:26:49,142 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-47) [3421cc4] Adding task b39ffee3-0ba7-46af-9137-187bf7aefd5e to DataBase >2012-08-06 12:26:49,171 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-47) [3421cc4] Adding task b39ffee3-0ba7-46af-9137-187bf7aefd5e (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 12:26:49,351 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) [3421cc4] BaseAsyncTask::StartPollingTask: Starting to poll task b39ffee3-0ba7-46af-9137-187bf7aefd5e. >2012-08-06 12:26:49,352 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-47) [3421cc4] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity a6c1ef37-5de7-403f-aecd-0185a55c3046 is RemoveVm (determined by task b39ffee3-0ba7-46af-9137-187bf7aefd5e) >2012-08-06 12:26:49,472 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) [2546ba70] Running command: RemoveVmCommand internal: false. Entities affected : ID: ad77ef63-994a-4f05-ae14-9488e891a059 Type: VM >2012-08-06 12:26:49,477 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) [2546ba70] START, SetVmStatusVDSCommand(vmId = ad77ef63-994a-4f05-ae14-9488e891a059, status = ImageLocked), log id: 69e5751 >2012-08-06 12:26:49,483 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) [2546ba70] FINISH, SetVmStatusVDSCommand, log id: 69e5751 >2012-08-06 12:26:49,502 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) [2546ba70] Lock freed to object EngineLock [exclusiveLocks= key: ad77ef63-994a-4f05-ae14-9488e891a059 value: VM >, sharedLocks= ] >2012-08-06 12:26:49,505 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-47) [2546ba70] START, RemoveVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = ad77ef63-994a-4f05-ae14-9488e891a059), log id: 7d0b1c9e >2012-08-06 12:26:49,569 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-47) [2546ba70] FINISH, RemoveVMVDSCommand, log id: 7d0b1c9e >2012-08-06 12:26:49,574 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-3-thread-47) [64840934] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: ad77ef63-994a-4f05-ae14-9488e891a059 Type: VM >2012-08-06 12:26:49,583 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-3-thread-47) [74451e8e] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 12:26:49,607 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-47) [74451e8e] START, DeleteImageGroupVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = e4c5a274-d1b0-4966-a56f-a939cccb5018, postZeros = false, forceDelete = false), log id: 510edbc6 >2012-08-06 12:26:49,861 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-47) [74451e8e] FINISH, DeleteImageGroupVDSCommand, log id: 510edbc6 >2012-08-06 12:26:49,924 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) [74451e8e] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity ad77ef63-994a-4f05-ae14-9488e891a059 >2012-08-06 12:26:49,927 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-47) [74451e8e] EntityMultiAsyncTasks::AttachTask: Attaching task d21cfe70-5b61-41d5-871e-31a739f216c7 to entity ad77ef63-994a-4f05-ae14-9488e891a059. >2012-08-06 12:26:49,932 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-47) [74451e8e] Adding task d21cfe70-5b61-41d5-871e-31a739f216c7 to DataBase >2012-08-06 12:26:49,963 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-47) [74451e8e] Adding task d21cfe70-5b61-41d5-871e-31a739f216c7 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 12:26:50,080 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) [74451e8e] BaseAsyncTask::StartPollingTask: Starting to poll task d21cfe70-5b61-41d5-871e-31a739f216c7. >2012-08-06 12:26:50,081 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-47) [74451e8e] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity ad77ef63-994a-4f05-ae14-9488e891a059 is RemoveVm (determined by task d21cfe70-5b61-41d5-871e-31a739f216c7) >2012-08-06 12:26:50,181 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) [467a222e] Running command: RemoveVmCommand internal: false. Entities affected : ID: de370719-d4d0-4299-93d6-2fc4a274aa28 Type: VM >2012-08-06 12:26:50,187 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) [467a222e] START, SetVmStatusVDSCommand(vmId = de370719-d4d0-4299-93d6-2fc4a274aa28, status = ImageLocked), log id: 5f51337c >2012-08-06 12:26:50,193 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) [467a222e] FINISH, SetVmStatusVDSCommand, log id: 5f51337c >2012-08-06 12:26:50,240 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) [467a222e] Lock freed to object EngineLock [exclusiveLocks= key: de370719-d4d0-4299-93d6-2fc4a274aa28 value: VM >, sharedLocks= ] >2012-08-06 12:26:50,243 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-47) [467a222e] START, RemoveVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = de370719-d4d0-4299-93d6-2fc4a274aa28), log id: 425e3d8d >2012-08-06 12:26:50,316 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-47) [467a222e] FINISH, RemoveVMVDSCommand, log id: 425e3d8d >2012-08-06 12:26:50,320 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-3-thread-47) [2142bf8d] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: de370719-d4d0-4299-93d6-2fc4a274aa28 Type: VM >2012-08-06 12:26:50,335 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-3-thread-47) [75d5210d] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 12:26:50,365 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-47) [75d5210d] START, DeleteImageGroupVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0dc3326b-6e58-4117-8d83-77ab85529263, postZeros = false, forceDelete = false), log id: 32842a68 >2012-08-06 12:26:50,647 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-76) Polling and updating Async Tasks: 4 tasks, 3 tasks to poll now >2012-08-06 12:26:51,207 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-47) [75d5210d] FINISH, DeleteImageGroupVDSCommand, log id: 32842a68 >2012-08-06 12:26:51,228 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) [75d5210d] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity de370719-d4d0-4299-93d6-2fc4a274aa28 >2012-08-06 12:26:51,229 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-47) [75d5210d] EntityMultiAsyncTasks::AttachTask: Attaching task ddda46d3-5916-4886-a922-6790fe8be3fa to entity de370719-d4d0-4299-93d6-2fc4a274aa28. >2012-08-06 12:26:51,232 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-47) [75d5210d] Adding task ddda46d3-5916-4886-a922-6790fe8be3fa to DataBase >2012-08-06 12:26:51,441 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-76) SPMAsyncTask::PollTask: Polling task 1299a8f1-3bc9-4dbf-ba62-c1448f786169 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 12:26:51,462 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-76) BaseAsyncTask::OnTaskEndSuccess: Task 1299a8f1-3bc9-4dbf-ba62-c1448f786169 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 12:26:51,463 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-76) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 458adebd-ebe5-46f6-98a5-3359ab42f11b has ended -> executing EndAction >2012-08-06 12:26:51,467 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-76) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 458adebd-ebe5-46f6-98a5-3359ab42f11b): calling EndAction for action type RemoveVm. >2012-08-06 12:26:51,471 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction RemoveVm >2012-08-06 12:26:51,476 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-76) SPMAsyncTask::PollTask: Polling task d21cfe70-5b61-41d5-871e-31a739f216c7 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 12:26:51,499 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-50) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2012-08-06 12:26:51,500 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-50) Lock Acquired to object EngineLock [exclusiveLocks= key: 458adebd-ebe5-46f6-98a5-3359ab42f11b value: VM >, sharedLocks= ] >2012-08-06 12:26:51,507 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) MacPoolManager::freeMac(mac = 00:1a:4a:23:61:5e) - entered >2012-08-06 12:26:51,515 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-50) Lock freed to object EngineLock [exclusiveLocks= key: 458adebd-ebe5-46f6-98a5-3359ab42f11b value: VM >, sharedLocks= ] >2012-08-06 12:26:51,521 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-76) BaseAsyncTask::OnTaskEndSuccess: Task d21cfe70-5b61-41d5-871e-31a739f216c7 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 12:26:51,522 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-76) EntityAsyncTask::EndActionIfNecessary: All tasks of entity ad77ef63-994a-4f05-ae14-9488e891a059 has ended -> executing EndAction >2012-08-06 12:26:51,526 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-76) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: ad77ef63-994a-4f05-ae14-9488e891a059): calling EndAction for action type RemoveVm. >2012-08-06 12:26:51,530 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-46) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction RemoveVm >2012-08-06 12:26:51,538 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-76) SPMAsyncTask::PollTask: Polling task b39ffee3-0ba7-46af-9137-187bf7aefd5e (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 12:26:51,596 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-46) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2012-08-06 12:26:51,597 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-46) Lock Acquired to object EngineLock [exclusiveLocks= key: ad77ef63-994a-4f05-ae14-9488e891a059 value: VM >, sharedLocks= ] >2012-08-06 12:26:51,605 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-46) MacPoolManager::freeMac(mac = 00:1a:4a:23:61:5c) - entered >2012-08-06 12:26:51,612 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-76) BaseAsyncTask::OnTaskEndSuccess: Task b39ffee3-0ba7-46af-9137-187bf7aefd5e (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 12:26:51,614 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2012-08-06 12:26:51,615 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2012-08-06 12:26:51,615 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-76) EntityAsyncTask::EndActionIfNecessary: All tasks of entity a6c1ef37-5de7-403f-aecd-0185a55c3046 has ended -> executing EndAction >2012-08-06 12:26:51,618 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-76) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: a6c1ef37-5de7-403f-aecd-0185a55c3046): calling EndAction for action type RemoveVm. >2012-08-06 12:26:51,619 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction RemoveVm >2012-08-06 12:26:51,625 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-46) Lock freed to object EngineLock [exclusiveLocks= key: ad77ef63-994a-4f05-ae14-9488e891a059 value: VM >, sharedLocks= ] >2012-08-06 12:26:51,626 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-47) [75d5210d] Adding task ddda46d3-5916-4886-a922-6790fe8be3fa (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 12:26:51,667 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 1299a8f1-3bc9-4dbf-ba62-c1448f786169 >2012-08-06 12:26:51,684 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-50) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 1299a8f1-3bc9-4dbf-ba62-c1448f786169), log id: 6e6d7077 >2012-08-06 12:26:51,687 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-42) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2012-08-06 12:26:51,700 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-42) Lock Acquired to object EngineLock [exclusiveLocks= key: a6c1ef37-5de7-403f-aecd-0185a55c3046 value: VM >, sharedLocks= ] >2012-08-06 12:26:51,704 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-46) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2012-08-06 12:26:51,705 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-46) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2012-08-06 12:26:51,709 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-50) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=1299a8f1-3bc9-4dbf-ba62-c1448f786169), log id: 1b8083cd >2012-08-06 12:26:51,720 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-46) SPMAsyncTask::ClearAsyncTask: Attempting to clear task d21cfe70-5b61-41d5-871e-31a739f216c7 >2012-08-06 12:26:51,726 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-46) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = d21cfe70-5b61-41d5-871e-31a739f216c7), log id: 3dba070c >2012-08-06 12:26:51,716 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-42) MacPoolManager::freeMac(mac = 00:1a:4a:23:61:5b) - entered >2012-08-06 12:26:51,734 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-42) Lock freed to object EngineLock [exclusiveLocks= key: a6c1ef37-5de7-403f-aecd-0185a55c3046 value: VM >, sharedLocks= ] >2012-08-06 12:26:51,772 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2012-08-06 12:26:51,773 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2012-08-06 12:26:51,788 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-42) SPMAsyncTask::ClearAsyncTask: Attempting to clear task b39ffee3-0ba7-46af-9137-187bf7aefd5e >2012-08-06 12:26:51,789 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-42) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = b39ffee3-0ba7-46af-9137-187bf7aefd5e), log id: 4f9c925a >2012-08-06 12:26:51,822 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 1b8083cd >2012-08-06 12:26:51,823 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 6e6d7077 >2012-08-06 12:26:51,838 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task 1299a8f1-3bc9-4dbf-ba62-c1448f786169 from DataBase >2012-08-06 12:26:51,839 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 458adebd-ebe5-46f6-98a5-3359ab42f11b >2012-08-06 12:26:51,849 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) [75d5210d] BaseAsyncTask::StartPollingTask: Starting to poll task ddda46d3-5916-4886-a922-6790fe8be3fa. >2012-08-06 12:26:51,850 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-47) [75d5210d] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity de370719-d4d0-4299-93d6-2fc4a274aa28 is RemoveVm (determined by task ddda46d3-5916-4886-a922-6790fe8be3fa) >2012-08-06 12:26:51,890 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-42) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=b39ffee3-0ba7-46af-9137-187bf7aefd5e), log id: 1909f180 >2012-08-06 12:26:51,946 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-42) FINISH, HSMClearTaskVDSCommand, log id: 1909f180 >2012-08-06 12:26:51,947 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-42) FINISH, SPMClearTaskVDSCommand, log id: 4f9c925a >2012-08-06 12:26:51,948 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-46) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=d21cfe70-5b61-41d5-871e-31a739f216c7), log id: 7be41025 >2012-08-06 12:26:51,990 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-46) FINISH, HSMClearTaskVDSCommand, log id: 7be41025 >2012-08-06 12:26:51,990 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-46) FINISH, SPMClearTaskVDSCommand, log id: 3dba070c >2012-08-06 12:26:51,993 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) [7c5a1e27] Running command: RemoveVmCommand internal: false. Entities affected : ID: 3ee28762-5b38-409a-8e34-aebd1ed491f6 Type: VM >2012-08-06 12:26:51,995 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) [7c5a1e27] START, SetVmStatusVDSCommand(vmId = 3ee28762-5b38-409a-8e34-aebd1ed491f6, status = ImageLocked), log id: 7eaa4e3 >2012-08-06 12:26:52,003 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) [7c5a1e27] FINISH, SetVmStatusVDSCommand, log id: 7eaa4e3 >2012-08-06 12:26:52,034 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-42) BaseAsyncTask::RemoveTaskFromDB: Removed task b39ffee3-0ba7-46af-9137-187bf7aefd5e from DataBase >2012-08-06 12:26:52,034 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity a6c1ef37-5de7-403f-aecd-0185a55c3046 >2012-08-06 12:26:52,035 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-46) BaseAsyncTask::RemoveTaskFromDB: Removed task d21cfe70-5b61-41d5-871e-31a739f216c7 from DataBase >2012-08-06 12:26:52,037 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-46) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity ad77ef63-994a-4f05-ae14-9488e891a059 >2012-08-06 12:26:52,073 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) [7c5a1e27] Lock freed to object EngineLock [exclusiveLocks= key: 3ee28762-5b38-409a-8e34-aebd1ed491f6 value: VM >, sharedLocks= ] >2012-08-06 12:26:52,078 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-47) [7c5a1e27] START, RemoveVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = 3ee28762-5b38-409a-8e34-aebd1ed491f6), log id: 69f6300d >2012-08-06 12:26:52,131 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-47) [7c5a1e27] FINISH, RemoveVMVDSCommand, log id: 69f6300d >2012-08-06 12:26:52,137 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-3-thread-47) [21ccdbd4] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: 3ee28762-5b38-409a-8e34-aebd1ed491f6 Type: VM >2012-08-06 12:26:52,150 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-3-thread-47) [239759b9] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 12:26:52,173 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-47) [239759b9] START, DeleteImageGroupVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 7f7d0278-869e-4ed6-8277-6df2825a57d2, postZeros = false, forceDelete = false), log id: 6b670bec >2012-08-06 12:26:52,413 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-47) [239759b9] FINISH, DeleteImageGroupVDSCommand, log id: 6b670bec >2012-08-06 12:26:52,430 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) [239759b9] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 3ee28762-5b38-409a-8e34-aebd1ed491f6 >2012-08-06 12:26:52,434 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-47) [239759b9] EntityMultiAsyncTasks::AttachTask: Attaching task 0676625d-ad7f-4767-8e28-6afb7ba74e71 to entity 3ee28762-5b38-409a-8e34-aebd1ed491f6. >2012-08-06 12:26:52,439 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-47) [239759b9] Adding task 0676625d-ad7f-4767-8e28-6afb7ba74e71 to DataBase >2012-08-06 12:26:52,490 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-47) [239759b9] Adding task 0676625d-ad7f-4767-8e28-6afb7ba74e71 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 12:26:52,645 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) [239759b9] BaseAsyncTask::StartPollingTask: Starting to poll task 0676625d-ad7f-4767-8e28-6afb7ba74e71. >2012-08-06 12:26:52,646 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-47) [239759b9] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 3ee28762-5b38-409a-8e34-aebd1ed491f6 is RemoveVm (determined by task 0676625d-ad7f-4767-8e28-6afb7ba74e71) >2012-08-06 12:26:52,715 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) [71d239] Running command: RemoveVmCommand internal: false. Entities affected : ID: 95b9258b-9b92-4b12-93fa-b5056b9176d9 Type: VM >2012-08-06 12:26:52,719 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) [71d239] START, SetVmStatusVDSCommand(vmId = 95b9258b-9b92-4b12-93fa-b5056b9176d9, status = ImageLocked), log id: 18c03a27 >2012-08-06 12:26:52,726 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) [71d239] FINISH, SetVmStatusVDSCommand, log id: 18c03a27 >2012-08-06 12:26:52,738 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) [71d239] Lock freed to object EngineLock [exclusiveLocks= key: 95b9258b-9b92-4b12-93fa-b5056b9176d9 value: VM >, sharedLocks= ] >2012-08-06 12:26:52,742 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-47) [71d239] START, RemoveVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = 95b9258b-9b92-4b12-93fa-b5056b9176d9), log id: 7d25cece >2012-08-06 12:26:52,794 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-47) [71d239] FINISH, RemoveVMVDSCommand, log id: 7d25cece >2012-08-06 12:26:52,798 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-3-thread-47) [3d2c7692] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: 95b9258b-9b92-4b12-93fa-b5056b9176d9 Type: VM >2012-08-06 12:26:52,812 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-3-thread-47) [4e866934] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 12:26:52,836 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-47) [4e866934] START, DeleteImageGroupVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 530b2043-4d0e-433d-9e43-562abe9fcf93, postZeros = false, forceDelete = false), log id: 660b9898 >2012-08-06 12:26:53,061 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 1/7 (Command type: RemoveVm) >2012-08-06 12:26:53,063 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 2/7 (Command type: RemoveVm) >2012-08-06 12:26:53,064 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-34) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 3/7 (Command type: RemoveVm) >2012-08-06 12:26:53,065 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 4/7 (Command type: RemoveVm) >2012-08-06 12:26:53,066 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 5/7 (Command type: RemoveVm) >2012-08-06 12:26:53,067 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 6/7 (Command type: RemoveVm) >2012-08-06 12:26:53,069 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/6/12 12:26 PM. Start running CanDoAction for command number 7/7 (Command type: RemoveVm) >2012-08-06 12:26:53,095 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-45) Lock Acquired to object EngineLock [exclusiveLocks= key: 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3 value: VM >, sharedLocks= ] >2012-08-06 12:26:53,103 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-34) Lock Acquired to object EngineLock [exclusiveLocks= key: 10ef6062-3141-48a6-a778-c79f7a47154e value: VM >, sharedLocks= ] >2012-08-06 12:26:53,103 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-44) Lock Acquired to object EngineLock [exclusiveLocks= key: c26afa24-84a3-4a85-939b-c8b0b293a8e9 value: VM >, sharedLocks= ] >2012-08-06 12:26:53,102 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-50) Lock Acquired to object EngineLock [exclusiveLocks= key: 4dfd7e9a-0245-403d-8fe6-f415f61121af value: VM >, sharedLocks= ] >2012-08-06 12:26:53,099 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-43) Lock Acquired to object EngineLock [exclusiveLocks= key: 66e09847-ee2c-4385-91d2-e7b698d53f85 value: VM >, sharedLocks= ] >2012-08-06 12:26:53,099 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-49) Lock Acquired to object EngineLock [exclusiveLocks= key: 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94 value: VM >, sharedLocks= ] >2012-08-06 12:26:53,115 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-46) Lock Acquired to object EngineLock [exclusiveLocks= key: e047ae8c-befe-4805-bc8c-929bb3408fbe value: VM >, sharedLocks= ] >2012-08-06 12:26:53,160 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 579caf04 >2012-08-06 12:26:53,165 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-34) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 5ebd1d9 >2012-08-06 12:26:53,168 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 11aad4b7 >2012-08-06 12:26:53,171 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4b7cdfa7 >2012-08-06 12:26:53,173 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 56aae07e >2012-08-06 12:26:53,176 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 2764c043 >2012-08-06 12:26:53,178 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) FINISH, IsValidVDSCommand, return: true, log id: 2764c043 >2012-08-06 12:26:53,182 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-44) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 74d0d170 >2012-08-06 12:26:53,184 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-44) FINISH, IsValidVDSCommand, return: true, log id: 74d0d170 >2012-08-06 12:26:53,186 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) FINISH, IsValidVDSCommand, return: true, log id: 11aad4b7 >2012-08-06 12:26:53,190 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) FINISH, IsValidVDSCommand, return: true, log id: 579caf04 >2012-08-06 12:26:53,194 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) FINISH, IsValidVDSCommand, return: true, log id: 4b7cdfa7 >2012-08-06 12:26:53,195 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-34) FINISH, IsValidVDSCommand, return: true, log id: 5ebd1d9 >2012-08-06 12:26:53,198 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) FINISH, IsValidVDSCommand, return: true, log id: 56aae07e >2012-08-06 12:26:53,222 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 5/7 (Command type: RemoveVm) >2012-08-06 12:26:53,244 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 4/7 (Command type: RemoveVm) >2012-08-06 12:26:53,245 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 7/7 (Command type: RemoveVm) >2012-08-06 12:26:53,246 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 2/7 (Command type: RemoveVm) >2012-08-06 12:26:53,247 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 1/7 (Command type: RemoveVm) >2012-08-06 12:26:53,247 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 6/7 (Command type: RemoveVm) >2012-08-06 12:26:53,248 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-34) End time: 8/6/12 12:26 PM. Finish handling CanDoAction for command number 3/7 (Command type: RemoveVm) >2012-08-06 12:26:53,306 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-34) [37a1bec9] Running command: RemoveVmCommand internal: false. Entities affected : ID: e047ae8c-befe-4805-bc8c-929bb3408fbe Type: VM >2012-08-06 12:26:53,308 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-34) [37a1bec9] START, SetVmStatusVDSCommand(vmId = e047ae8c-befe-4805-bc8c-929bb3408fbe, status = ImageLocked), log id: 24829ec3 >2012-08-06 12:26:53,320 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-34) [37a1bec9] FINISH, SetVmStatusVDSCommand, log id: 24829ec3 >2012-08-06 12:26:53,336 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-34) [37a1bec9] Lock freed to object EngineLock [exclusiveLocks= key: e047ae8c-befe-4805-bc8c-929bb3408fbe value: VM >, sharedLocks= ] >2012-08-06 12:26:53,338 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-34) [37a1bec9] START, RemoveVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = e047ae8c-befe-4805-bc8c-929bb3408fbe), log id: 6ed3d525 >2012-08-06 12:26:53,346 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-47) [4e866934] FINISH, DeleteImageGroupVDSCommand, log id: 660b9898 >2012-08-06 12:26:53,360 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) [4e866934] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 95b9258b-9b92-4b12-93fa-b5056b9176d9 >2012-08-06 12:26:53,361 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-47) [4e866934] EntityMultiAsyncTasks::AttachTask: Attaching task f11218cd-c338-42b4-b042-12926bb8c5a6 to entity 95b9258b-9b92-4b12-93fa-b5056b9176d9. >2012-08-06 12:26:53,363 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-47) [4e866934] Adding task f11218cd-c338-42b4-b042-12926bb8c5a6 to DataBase >2012-08-06 12:26:53,394 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-47) [4e866934] Adding task f11218cd-c338-42b4-b042-12926bb8c5a6 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 12:26:53,438 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-34) [37a1bec9] FINISH, RemoveVMVDSCommand, log id: 6ed3d525 >2012-08-06 12:26:53,442 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-3-thread-34) [32b95221] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: e047ae8c-befe-4805-bc8c-929bb3408fbe Type: VM >2012-08-06 12:26:53,454 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-3-thread-34) [447dad0d] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 12:26:53,486 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-34) [447dad0d] START, DeleteImageGroupVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = defea5bf-fa7b-4b85-acb3-bab8d91c9966, postZeros = false, forceDelete = false), log id: 1f2e32b0 >2012-08-06 12:26:53,529 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) [4e866934] BaseAsyncTask::StartPollingTask: Starting to poll task f11218cd-c338-42b4-b042-12926bb8c5a6. >2012-08-06 12:26:53,530 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-47) [4e866934] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 95b9258b-9b92-4b12-93fa-b5056b9176d9 is RemoveVm (determined by task f11218cd-c338-42b4-b042-12926bb8c5a6) >2012-08-06 12:26:53,615 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) [30a09c69] Running command: RemoveVmCommand internal: false. Entities affected : ID: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 Type: VM >2012-08-06 12:26:53,620 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) [30a09c69] START, SetVmStatusVDSCommand(vmId = 3c5452c9-a5e2-46af-90b5-b568da5dc3d4, status = ImageLocked), log id: 2254a684 >2012-08-06 12:26:53,631 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) [30a09c69] FINISH, SetVmStatusVDSCommand, log id: 2254a684 >2012-08-06 12:26:53,690 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) [30a09c69] Lock freed to object EngineLock [exclusiveLocks= key: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 value: VM >, sharedLocks= ] >2012-08-06 12:26:53,692 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-47) [30a09c69] START, RemoveVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = 3c5452c9-a5e2-46af-90b5-b568da5dc3d4), log id: 5a98d990 >2012-08-06 12:26:53,893 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-34) [447dad0d] FINISH, DeleteImageGroupVDSCommand, log id: 1f2e32b0 >2012-08-06 12:26:53,921 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-34) [447dad0d] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity e047ae8c-befe-4805-bc8c-929bb3408fbe >2012-08-06 12:26:53,922 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-34) [447dad0d] EntityMultiAsyncTasks::AttachTask: Attaching task 4c05f367-293b-4d7f-a6b6-7f187c125810 to entity e047ae8c-befe-4805-bc8c-929bb3408fbe. >2012-08-06 12:26:53,924 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-34) [447dad0d] Adding task 4c05f367-293b-4d7f-a6b6-7f187c125810 to DataBase >2012-08-06 12:26:53,932 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-47) [30a09c69] FINISH, RemoveVMVDSCommand, log id: 5a98d990 >2012-08-06 12:26:53,938 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-3-thread-47) [58cc0c53] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 Type: VM >2012-08-06 12:26:53,960 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-3-thread-47) [747c71cf] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 12:26:53,964 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-34) [447dad0d] Adding task 4c05f367-293b-4d7f-a6b6-7f187c125810 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 12:26:53,991 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-47) [747c71cf] START, DeleteImageGroupVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 39207fa9-2d8b-4c91-a8d6-79bc119b38dd, postZeros = false, forceDelete = false), log id: 2035ae4 >2012-08-06 12:26:54,043 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-34) [447dad0d] BaseAsyncTask::StartPollingTask: Starting to poll task 4c05f367-293b-4d7f-a6b6-7f187c125810. >2012-08-06 12:26:54,046 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-34) [447dad0d] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity e047ae8c-befe-4805-bc8c-929bb3408fbe is RemoveVm (determined by task 4c05f367-293b-4d7f-a6b6-7f187c125810) >2012-08-06 12:26:54,192 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-34) [5bf49aa7] Running command: RemoveVmCommand internal: false. Entities affected : ID: 4dfd7e9a-0245-403d-8fe6-f415f61121af Type: VM >2012-08-06 12:26:54,197 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-34) [5bf49aa7] START, SetVmStatusVDSCommand(vmId = 4dfd7e9a-0245-403d-8fe6-f415f61121af, status = ImageLocked), log id: 62e64077 >2012-08-06 12:26:54,204 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-34) [5bf49aa7] FINISH, SetVmStatusVDSCommand, log id: 62e64077 >2012-08-06 12:26:54,218 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-34) [5bf49aa7] Lock freed to object EngineLock [exclusiveLocks= key: 4dfd7e9a-0245-403d-8fe6-f415f61121af value: VM >, sharedLocks= ] >2012-08-06 12:26:54,222 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-34) [5bf49aa7] START, RemoveVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = 4dfd7e9a-0245-403d-8fe6-f415f61121af), log id: 7d8f667b >2012-08-06 12:26:54,345 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-47) [747c71cf] FINISH, DeleteImageGroupVDSCommand, log id: 2035ae4 >2012-08-06 12:26:54,360 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) [747c71cf] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 >2012-08-06 12:26:54,361 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-47) [747c71cf] EntityMultiAsyncTasks::AttachTask: Attaching task 1ea919f1-f685-48f2-8b68-3b65011bb2f2 to entity 3c5452c9-a5e2-46af-90b5-b568da5dc3d4. >2012-08-06 12:26:54,366 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-47) [747c71cf] Adding task 1ea919f1-f685-48f2-8b68-3b65011bb2f2 to DataBase >2012-08-06 12:26:54,397 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-47) [747c71cf] Adding task 1ea919f1-f685-48f2-8b68-3b65011bb2f2 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 12:26:54,411 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-34) [5bf49aa7] FINISH, RemoveVMVDSCommand, log id: 7d8f667b >2012-08-06 12:26:54,418 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-3-thread-34) [1e79d26a] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: 4dfd7e9a-0245-403d-8fe6-f415f61121af Type: VM >2012-08-06 12:26:54,438 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-3-thread-34) [3928c465] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 12:26:54,488 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-34) [3928c465] START, DeleteImageGroupVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 7e1d2bb1-9a49-4c3a-914d-8604d49f9f5f, postZeros = false, forceDelete = false), log id: 3a9a085a >2012-08-06 12:26:54,551 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) [747c71cf] BaseAsyncTask::StartPollingTask: Starting to poll task 1ea919f1-f685-48f2-8b68-3b65011bb2f2. >2012-08-06 12:26:54,554 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-47) [747c71cf] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 is RemoveVm (determined by task 1ea919f1-f685-48f2-8b68-3b65011bb2f2) >2012-08-06 12:26:54,606 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) [7cca70] Running command: RemoveVmCommand internal: false. Entities affected : ID: 6a8ef0f6-c139-41d9-a814-60ca51daa5f4 Type: VM >2012-08-06 12:26:54,611 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) [7cca70] START, SetVmStatusVDSCommand(vmId = 6a8ef0f6-c139-41d9-a814-60ca51daa5f4, status = ImageLocked), log id: 7118733e >2012-08-06 12:26:54,618 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) [7cca70] FINISH, SetVmStatusVDSCommand, log id: 7118733e >2012-08-06 12:26:54,640 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) [7cca70] Lock freed to object EngineLock [exclusiveLocks= key: 6a8ef0f6-c139-41d9-a814-60ca51daa5f4 value: VM >, sharedLocks= ] >2012-08-06 12:26:54,644 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-47) [7cca70] START, RemoveVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = 6a8ef0f6-c139-41d9-a814-60ca51daa5f4), log id: 29c946be >2012-08-06 12:26:55,124 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-34) [3928c465] FINISH, DeleteImageGroupVDSCommand, log id: 3a9a085a >2012-08-06 12:26:55,139 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-34) [3928c465] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 4dfd7e9a-0245-403d-8fe6-f415f61121af >2012-08-06 12:26:55,139 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-34) [3928c465] EntityMultiAsyncTasks::AttachTask: Attaching task ca5dbd79-1565-46db-9500-23314f2994c8 to entity 4dfd7e9a-0245-403d-8fe6-f415f61121af. >2012-08-06 12:26:55,144 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-34) [3928c465] Adding task ca5dbd79-1565-46db-9500-23314f2994c8 to DataBase >2012-08-06 12:26:55,179 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-34) [3928c465] Adding task ca5dbd79-1565-46db-9500-23314f2994c8 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 12:26:55,189 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-47) [7cca70] FINISH, RemoveVMVDSCommand, log id: 29c946be >2012-08-06 12:26:55,195 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-3-thread-47) [4e843b9f] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: 6a8ef0f6-c139-41d9-a814-60ca51daa5f4 Type: VM >2012-08-06 12:26:55,206 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-3-thread-47) [7c8361c7] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 12:26:55,232 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-47) [7c8361c7] START, DeleteImageGroupVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 3e3d72e9-e806-4e3d-810f-279907509728, postZeros = false, forceDelete = false), log id: 2ffc5e8c >2012-08-06 12:26:55,317 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-34) [3928c465] BaseAsyncTask::StartPollingTask: Starting to poll task ca5dbd79-1565-46db-9500-23314f2994c8. >2012-08-06 12:26:55,318 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-34) [3928c465] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 4dfd7e9a-0245-403d-8fe6-f415f61121af is RemoveVm (determined by task ca5dbd79-1565-46db-9500-23314f2994c8) >2012-08-06 12:26:55,384 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-34) [17d5791b] Running command: RemoveVmCommand internal: false. Entities affected : ID: 10ef6062-3141-48a6-a778-c79f7a47154e Type: VM >2012-08-06 12:26:55,390 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-34) [17d5791b] START, SetVmStatusVDSCommand(vmId = 10ef6062-3141-48a6-a778-c79f7a47154e, status = ImageLocked), log id: 728ef4d5 >2012-08-06 12:26:55,396 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-34) [17d5791b] FINISH, SetVmStatusVDSCommand, log id: 728ef4d5 >2012-08-06 12:26:55,449 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-34) [17d5791b] Lock freed to object EngineLock [exclusiveLocks= key: 10ef6062-3141-48a6-a778-c79f7a47154e value: VM >, sharedLocks= ] >2012-08-06 12:26:55,453 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-34) [17d5791b] START, RemoveVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = 10ef6062-3141-48a6-a778-c79f7a47154e), log id: 67f28a8 >2012-08-06 12:26:55,535 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-47) [7c8361c7] FINISH, DeleteImageGroupVDSCommand, log id: 2ffc5e8c >2012-08-06 12:26:55,552 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) [7c8361c7] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 6a8ef0f6-c139-41d9-a814-60ca51daa5f4 >2012-08-06 12:26:55,552 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-47) [7c8361c7] EntityMultiAsyncTasks::AttachTask: Attaching task e5f69464-646c-4587-838f-942f066219de to entity 6a8ef0f6-c139-41d9-a814-60ca51daa5f4. >2012-08-06 12:26:55,554 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-47) [7c8361c7] Adding task e5f69464-646c-4587-838f-942f066219de to DataBase >2012-08-06 12:26:55,570 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-34) [17d5791b] FINISH, RemoveVMVDSCommand, log id: 67f28a8 >2012-08-06 12:26:55,574 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-3-thread-34) [4b231c08] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: 10ef6062-3141-48a6-a778-c79f7a47154e Type: VM >2012-08-06 12:26:55,584 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-47) [7c8361c7] Adding task e5f69464-646c-4587-838f-942f066219de (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 12:26:55,595 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-3-thread-34) [7bf9325e] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 12:26:55,648 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-34) [7bf9325e] START, DeleteImageGroupVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = aab8ddd3-c8ba-48f7-81e0-aee057f98c74, postZeros = false, forceDelete = false), log id: 44064242 >2012-08-06 12:26:55,704 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) [7c8361c7] BaseAsyncTask::StartPollingTask: Starting to poll task e5f69464-646c-4587-838f-942f066219de. >2012-08-06 12:26:55,704 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-47) [7c8361c7] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 6a8ef0f6-c139-41d9-a814-60ca51daa5f4 is RemoveVm (determined by task e5f69464-646c-4587-838f-942f066219de) >2012-08-06 12:26:56,148 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-34) [7bf9325e] FINISH, DeleteImageGroupVDSCommand, log id: 44064242 >2012-08-06 12:26:56,162 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-34) [7bf9325e] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 10ef6062-3141-48a6-a778-c79f7a47154e >2012-08-06 12:26:56,165 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-34) [7bf9325e] EntityMultiAsyncTasks::AttachTask: Attaching task 98e1baad-cbfa-4a15-92bb-0164a2d6e488 to entity 10ef6062-3141-48a6-a778-c79f7a47154e. >2012-08-06 12:26:56,170 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-34) [7bf9325e] Adding task 98e1baad-cbfa-4a15-92bb-0164a2d6e488 to DataBase >2012-08-06 12:26:56,208 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-34) [7bf9325e] Adding task 98e1baad-cbfa-4a15-92bb-0164a2d6e488 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 12:26:56,291 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-34) [7bf9325e] BaseAsyncTask::StartPollingTask: Starting to poll task 98e1baad-cbfa-4a15-92bb-0164a2d6e488. >2012-08-06 12:26:56,294 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-34) [7bf9325e] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 10ef6062-3141-48a6-a778-c79f7a47154e is RemoveVm (determined by task 98e1baad-cbfa-4a15-92bb-0164a2d6e488) >2012-08-06 12:26:56,358 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-34) [4001e7d6] Running command: RemoveVmCommand internal: false. Entities affected : ID: 66e09847-ee2c-4385-91d2-e7b698d53f85 Type: VM >2012-08-06 12:26:56,364 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-34) [4001e7d6] START, SetVmStatusVDSCommand(vmId = 66e09847-ee2c-4385-91d2-e7b698d53f85, status = ImageLocked), log id: 6137cd12 >2012-08-06 12:26:56,372 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-34) [4001e7d6] FINISH, SetVmStatusVDSCommand, log id: 6137cd12 >2012-08-06 12:26:56,386 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-34) [4001e7d6] Lock freed to object EngineLock [exclusiveLocks= key: 66e09847-ee2c-4385-91d2-e7b698d53f85 value: VM >, sharedLocks= ] >2012-08-06 12:26:56,390 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-34) [4001e7d6] START, RemoveVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = 66e09847-ee2c-4385-91d2-e7b698d53f85), log id: 1471d0b0 >2012-08-06 12:26:56,450 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-34) [4001e7d6] FINISH, RemoveVMVDSCommand, log id: 1471d0b0 >2012-08-06 12:26:56,454 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-3-thread-34) [3c3bdd4c] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: 66e09847-ee2c-4385-91d2-e7b698d53f85 Type: VM >2012-08-06 12:26:56,468 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-3-thread-34) [34f5bd0c] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 12:26:56,490 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-34) [34f5bd0c] START, DeleteImageGroupVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 5ddd1197-ad22-48fe-a444-b4f3247329e9, postZeros = false, forceDelete = false), log id: 6c8ee0d1 >2012-08-06 12:26:56,849 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-34) [34f5bd0c] FINISH, DeleteImageGroupVDSCommand, log id: 6c8ee0d1 >2012-08-06 12:26:56,864 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-7) Setting new tasks map. The map contains now 11 tasks >2012-08-06 12:26:56,867 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-34) [34f5bd0c] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 66e09847-ee2c-4385-91d2-e7b698d53f85 >2012-08-06 12:26:56,868 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-34) [34f5bd0c] EntityMultiAsyncTasks::AttachTask: Attaching task 00efd7e6-aea7-44a2-85d7-6c59d7b18dbd to entity 66e09847-ee2c-4385-91d2-e7b698d53f85. >2012-08-06 12:26:56,872 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-34) [34f5bd0c] Adding task 00efd7e6-aea7-44a2-85d7-6c59d7b18dbd to DataBase >2012-08-06 12:26:56,908 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-34) [34f5bd0c] Adding task 00efd7e6-aea7-44a2-85d7-6c59d7b18dbd (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 12:26:56,997 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-34) [34f5bd0c] BaseAsyncTask::StartPollingTask: Starting to poll task 00efd7e6-aea7-44a2-85d7-6c59d7b18dbd. >2012-08-06 12:26:56,998 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-34) [34f5bd0c] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 66e09847-ee2c-4385-91d2-e7b698d53f85 is RemoveVm (determined by task 00efd7e6-aea7-44a2-85d7-6c59d7b18dbd) >2012-08-06 12:26:57,050 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-34) [33b8936f] Running command: RemoveVmCommand internal: false. Entities affected : ID: 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94 Type: VM >2012-08-06 12:26:57,055 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-34) [33b8936f] START, SetVmStatusVDSCommand(vmId = 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94, status = ImageLocked), log id: 431c6007 >2012-08-06 12:26:57,062 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-34) [33b8936f] FINISH, SetVmStatusVDSCommand, log id: 431c6007 >2012-08-06 12:26:57,089 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-34) [33b8936f] Lock freed to object EngineLock [exclusiveLocks= key: 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94 value: VM >, sharedLocks= ] >2012-08-06 12:26:57,094 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-34) [33b8936f] START, RemoveVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94), log id: 13a795a2 >2012-08-06 12:26:57,128 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-34) [33b8936f] FINISH, RemoveVMVDSCommand, log id: 13a795a2 >2012-08-06 12:26:57,133 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-3-thread-34) [5f50c8c2] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94 Type: VM >2012-08-06 12:26:57,142 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-3-thread-34) [5ff9a2da] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 12:26:57,169 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-34) [5ff9a2da] START, DeleteImageGroupVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 7104d1b5-968e-4035-973b-4c94cb7dba00, postZeros = false, forceDelete = false), log id: 46eae75d >2012-08-06 12:26:57,623 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-34) [5ff9a2da] FINISH, DeleteImageGroupVDSCommand, log id: 46eae75d >2012-08-06 12:26:57,635 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-34) [5ff9a2da] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94 >2012-08-06 12:26:57,638 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-34) [5ff9a2da] EntityMultiAsyncTasks::AttachTask: Attaching task c5d6fa56-13b9-41f1-ac65-6e49dbd6c65f to entity 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94. >2012-08-06 12:26:57,642 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-34) [5ff9a2da] Adding task c5d6fa56-13b9-41f1-ac65-6e49dbd6c65f to DataBase >2012-08-06 12:26:57,659 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-34) [5ff9a2da] Adding task c5d6fa56-13b9-41f1-ac65-6e49dbd6c65f (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 12:26:57,803 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-34) [5ff9a2da] BaseAsyncTask::StartPollingTask: Starting to poll task c5d6fa56-13b9-41f1-ac65-6e49dbd6c65f. >2012-08-06 12:26:57,804 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-34) [5ff9a2da] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94 is RemoveVm (determined by task c5d6fa56-13b9-41f1-ac65-6e49dbd6c65f) >2012-08-06 12:26:57,870 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-34) [1ad776f0] Running command: RemoveVmCommand internal: false. Entities affected : ID: c26afa24-84a3-4a85-939b-c8b0b293a8e9 Type: VM >2012-08-06 12:26:57,872 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-34) [1ad776f0] START, SetVmStatusVDSCommand(vmId = c26afa24-84a3-4a85-939b-c8b0b293a8e9, status = ImageLocked), log id: 6b2bfef6 >2012-08-06 12:26:57,892 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-34) [1ad776f0] FINISH, SetVmStatusVDSCommand, log id: 6b2bfef6 >2012-08-06 12:26:57,918 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-34) [1ad776f0] Lock freed to object EngineLock [exclusiveLocks= key: c26afa24-84a3-4a85-939b-c8b0b293a8e9 value: VM >, sharedLocks= ] >2012-08-06 12:26:57,919 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-34) [1ad776f0] START, RemoveVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = c26afa24-84a3-4a85-939b-c8b0b293a8e9), log id: 3cb5d646 >2012-08-06 12:26:57,982 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-34) [1ad776f0] FINISH, RemoveVMVDSCommand, log id: 3cb5d646 >2012-08-06 12:26:57,987 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-3-thread-34) [4606accd] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: c26afa24-84a3-4a85-939b-c8b0b293a8e9 Type: VM >2012-08-06 12:26:58,010 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-3-thread-34) [43f1e29b] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 12:26:58,032 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-34) [43f1e29b] START, DeleteImageGroupVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 2cb1a185-1403-4a6e-a51b-378a096de43a, postZeros = false, forceDelete = false), log id: 62fb8a03 >2012-08-06 12:26:58,527 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-34) [43f1e29b] FINISH, DeleteImageGroupVDSCommand, log id: 62fb8a03 >2012-08-06 12:26:58,549 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-34) [43f1e29b] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity c26afa24-84a3-4a85-939b-c8b0b293a8e9 >2012-08-06 12:26:58,552 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-34) [43f1e29b] EntityMultiAsyncTasks::AttachTask: Attaching task 50df53c0-f39a-42ce-9f9f-4c9eb88b27f1 to entity c26afa24-84a3-4a85-939b-c8b0b293a8e9. >2012-08-06 12:26:58,556 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-34) [43f1e29b] Adding task 50df53c0-f39a-42ce-9f9f-4c9eb88b27f1 to DataBase >2012-08-06 12:26:58,588 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-34) [43f1e29b] Adding task 50df53c0-f39a-42ce-9f9f-4c9eb88b27f1 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 12:26:58,772 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-34) [43f1e29b] BaseAsyncTask::StartPollingTask: Starting to poll task 50df53c0-f39a-42ce-9f9f-4c9eb88b27f1. >2012-08-06 12:26:58,773 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-34) [43f1e29b] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity c26afa24-84a3-4a85-939b-c8b0b293a8e9 is RemoveVm (determined by task 50df53c0-f39a-42ce-9f9f-4c9eb88b27f1) >2012-08-06 12:26:58,848 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-34) [37c19454] Running command: RemoveVmCommand internal: false. Entities affected : ID: 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3 Type: VM >2012-08-06 12:26:58,853 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-34) [37c19454] START, SetVmStatusVDSCommand(vmId = 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3, status = ImageLocked), log id: 1378bb66 >2012-08-06 12:26:58,859 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-34) [37c19454] FINISH, SetVmStatusVDSCommand, log id: 1378bb66 >2012-08-06 12:26:58,874 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-34) [37c19454] Lock freed to object EngineLock [exclusiveLocks= key: 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3 value: VM >, sharedLocks= ] >2012-08-06 12:26:58,878 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-34) [37c19454] START, RemoveVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3), log id: 6b27b75c >2012-08-06 12:26:58,958 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-34) [37c19454] FINISH, RemoveVMVDSCommand, log id: 6b27b75c >2012-08-06 12:26:58,963 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-3-thread-34) [6797c9fc] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3 Type: VM >2012-08-06 12:26:58,971 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-3-thread-34) [61d73460] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 12:26:58,991 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-34) [61d73460] START, DeleteImageGroupVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = c11fe8ad-261d-4b34-a034-e5772dc3305d, postZeros = false, forceDelete = false), log id: cc06811 >2012-08-06 12:26:59,282 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-34) [61d73460] FINISH, DeleteImageGroupVDSCommand, log id: cc06811 >2012-08-06 12:26:59,298 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-34) [61d73460] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3 >2012-08-06 12:26:59,301 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-34) [61d73460] EntityMultiAsyncTasks::AttachTask: Attaching task 4a3e7d3b-622b-406a-9245-6797e1199841 to entity 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3. >2012-08-06 12:26:59,306 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-34) [61d73460] Adding task 4a3e7d3b-622b-406a-9245-6797e1199841 to DataBase >2012-08-06 12:26:59,386 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-34) [61d73460] Adding task 4a3e7d3b-622b-406a-9245-6797e1199841 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 12:26:59,477 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-34) [61d73460] BaseAsyncTask::StartPollingTask: Starting to poll task 4a3e7d3b-622b-406a-9245-6797e1199841. >2012-08-06 12:26:59,481 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-34) [61d73460] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3 is RemoveVm (determined by task 4a3e7d3b-622b-406a-9245-6797e1199841) >2012-08-06 12:27:01,629 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-98) Polling and updating Async Tasks: 15 tasks, 12 tasks to poll now >2012-08-06 12:27:01,661 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) SPMAsyncTask::PollTask: Polling task 4c05f367-293b-4d7f-a6b6-7f187c125810 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 12:27:01,686 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) BaseAsyncTask::OnTaskEndSuccess: Task 4c05f367-293b-4d7f-a6b6-7f187c125810 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 12:27:01,691 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndActionIfNecessary: All tasks of entity e047ae8c-befe-4805-bc8c-929bb3408fbe has ended -> executing EndAction >2012-08-06 12:27:01,695 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: e047ae8c-befe-4805-bc8c-929bb3408fbe): calling EndAction for action type RemoveVm. >2012-08-06 12:27:01,699 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction RemoveVm >2012-08-06 12:27:01,702 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) SPMAsyncTask::PollTask: Polling task 00efd7e6-aea7-44a2-85d7-6c59d7b18dbd (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 12:27:01,722 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) BaseAsyncTask::OnTaskEndSuccess: Task 00efd7e6-aea7-44a2-85d7-6c59d7b18dbd (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 12:27:01,727 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 66e09847-ee2c-4385-91d2-e7b698d53f85 has ended -> executing EndAction >2012-08-06 12:27:01,731 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 66e09847-ee2c-4385-91d2-e7b698d53f85): calling EndAction for action type RemoveVm. >2012-08-06 12:27:01,735 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-34) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction RemoveVm >2012-08-06 12:27:01,736 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) SPMAsyncTask::PollTask: Polling task 0676625d-ad7f-4767-8e28-6afb7ba74e71 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 12:27:01,753 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-42) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2012-08-06 12:27:01,754 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-42) Lock Acquired to object EngineLock [exclusiveLocks= key: e047ae8c-befe-4805-bc8c-929bb3408fbe value: VM >, sharedLocks= ] >2012-08-06 12:27:01,761 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-42) MacPoolManager::freeMac(mac = 00:1a:4a:23:61:65) - entered >2012-08-06 12:27:01,771 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-42) Lock freed to object EngineLock [exclusiveLocks= key: e047ae8c-befe-4805-bc8c-929bb3408fbe value: VM >, sharedLocks= ] >2012-08-06 12:27:01,782 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) BaseAsyncTask::OnTaskEndSuccess: Task 0676625d-ad7f-4767-8e28-6afb7ba74e71 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 12:27:01,784 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 3ee28762-5b38-409a-8e34-aebd1ed491f6 has ended -> executing EndAction >2012-08-06 12:27:01,787 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 3ee28762-5b38-409a-8e34-aebd1ed491f6): calling EndAction for action type RemoveVm. >2012-08-06 12:27:01,791 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction RemoveVm >2012-08-06 12:27:01,796 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) SPMAsyncTask::PollTask: Polling task c5d6fa56-13b9-41f1-ac65-6e49dbd6c65f (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 12:27:01,829 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2012-08-06 12:27:01,830 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) Lock Acquired to object EngineLock [exclusiveLocks= key: 3ee28762-5b38-409a-8e34-aebd1ed491f6 value: VM >, sharedLocks= ] >2012-08-06 12:27:01,837 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-47) MacPoolManager::freeMac(mac = 00:1a:4a:23:61:73) - entered >2012-08-06 12:27:01,844 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) Lock freed to object EngineLock [exclusiveLocks= key: 3ee28762-5b38-409a-8e34-aebd1ed491f6 value: VM >, sharedLocks= ] >2012-08-06 12:27:01,862 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2012-08-06 12:27:01,863 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2012-08-06 12:27:01,864 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) BaseAsyncTask::OnTaskEndSuccess: Task c5d6fa56-13b9-41f1-ac65-6e49dbd6c65f (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 12:27:01,865 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-34) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2012-08-06 12:27:01,866 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-34) Lock Acquired to object EngineLock [exclusiveLocks= key: 66e09847-ee2c-4385-91d2-e7b698d53f85 value: VM >, sharedLocks= ] >2012-08-06 12:27:01,869 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94 has ended -> executing EndAction >2012-08-06 12:27:01,878 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94): calling EndAction for action type RemoveVm. >2012-08-06 12:27:01,883 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-34) MacPoolManager::freeMac(mac = 00:1a:4a:23:61:5a) - entered >2012-08-06 12:27:01,884 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction RemoveVm >2012-08-06 12:27:01,895 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) SPMAsyncTask::PollTask: Polling task e5f69464-646c-4587-838f-942f066219de (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 12:27:01,903 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-34) Lock freed to object EngineLock [exclusiveLocks= key: 66e09847-ee2c-4385-91d2-e7b698d53f85 value: VM >, sharedLocks= ] >2012-08-06 12:27:01,897 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-42) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 4c05f367-293b-4d7f-a6b6-7f187c125810 >2012-08-06 12:27:01,909 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-42) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 4c05f367-293b-4d7f-a6b6-7f187c125810), log id: 284f2ee9 >2012-08-06 12:27:01,912 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-42) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=4c05f367-293b-4d7f-a6b6-7f187c125810), log id: 6d11a58 >2012-08-06 12:27:01,939 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2012-08-06 12:27:01,939 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2012-08-06 12:27:01,940 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-44) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2012-08-06 12:27:01,942 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-44) Lock Acquired to object EngineLock [exclusiveLocks= key: 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94 value: VM >, sharedLocks= ] >2012-08-06 12:27:01,955 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) BaseAsyncTask::OnTaskEndSuccess: Task e5f69464-646c-4587-838f-942f066219de (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 12:27:01,958 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 6a8ef0f6-c139-41d9-a814-60ca51daa5f4 has ended -> executing EndAction >2012-08-06 12:27:01,964 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-44) MacPoolManager::freeMac(mac = 00:1a:4a:23:61:5f) - entered >2012-08-06 12:27:01,962 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-42) FINISH, HSMClearTaskVDSCommand, log id: 6d11a58 >2012-08-06 12:27:01,965 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-42) FINISH, SPMClearTaskVDSCommand, log id: 284f2ee9 >2012-08-06 12:27:01,968 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 6a8ef0f6-c139-41d9-a814-60ca51daa5f4): calling EndAction for action type RemoveVm. >2012-08-06 12:27:01,973 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-46) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction RemoveVm >2012-08-06 12:27:01,981 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) SPMAsyncTask::PollTask: Polling task ddda46d3-5916-4886-a922-6790fe8be3fa (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 12:27:01,997 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-44) Lock freed to object EngineLock [exclusiveLocks= key: 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94 value: VM >, sharedLocks= ] >2012-08-06 12:27:02,015 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 0676625d-ad7f-4767-8e28-6afb7ba74e71 >2012-08-06 12:27:02,016 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-47) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 0676625d-ad7f-4767-8e28-6afb7ba74e71), log id: 588b19c8 >2012-08-06 12:27:02,027 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-47) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=0676625d-ad7f-4767-8e28-6afb7ba74e71), log id: 3f0bdf9b >2012-08-06 12:27:02,079 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-47) FINISH, HSMClearTaskVDSCommand, log id: 3f0bdf9b >2012-08-06 12:27:02,080 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-47) FINISH, SPMClearTaskVDSCommand, log id: 588b19c8 >2012-08-06 12:27:02,081 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-34) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2012-08-06 12:27:02,082 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-34) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2012-08-06 12:27:02,083 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-42) BaseAsyncTask::RemoveTaskFromDB: Removed task 4c05f367-293b-4d7f-a6b6-7f187c125810 from DataBase >2012-08-06 12:27:02,084 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity e047ae8c-befe-4805-bc8c-929bb3408fbe >2012-08-06 12:27:02,086 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) BaseAsyncTask::OnTaskEndSuccess: Task ddda46d3-5916-4886-a922-6790fe8be3fa (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 12:27:02,089 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndActionIfNecessary: All tasks of entity de370719-d4d0-4299-93d6-2fc4a274aa28 has ended -> executing EndAction >2012-08-06 12:27:02,101 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: de370719-d4d0-4299-93d6-2fc4a274aa28): calling EndAction for action type RemoveVm. >2012-08-06 12:27:02,110 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction RemoveVm >2012-08-06 12:27:02,112 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) SPMAsyncTask::PollTask: Polling task f11218cd-c338-42b4-b042-12926bb8c5a6 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 12:27:02,133 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) BaseAsyncTask::RemoveTaskFromDB: Removed task 0676625d-ad7f-4767-8e28-6afb7ba74e71 from DataBase >2012-08-06 12:27:02,134 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 3ee28762-5b38-409a-8e34-aebd1ed491f6 >2012-08-06 12:27:02,145 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2012-08-06 12:27:02,146 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2012-08-06 12:27:02,147 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-50) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2012-08-06 12:27:02,151 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-50) Lock Acquired to object EngineLock [exclusiveLocks= key: de370719-d4d0-4299-93d6-2fc4a274aa28 value: VM >, sharedLocks= ] >2012-08-06 12:27:02,146 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-46) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2012-08-06 12:27:02,154 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-46) Lock Acquired to object EngineLock [exclusiveLocks= key: 6a8ef0f6-c139-41d9-a814-60ca51daa5f4 value: VM >, sharedLocks= ] >2012-08-06 12:27:02,146 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-34) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 00efd7e6-aea7-44a2-85d7-6c59d7b18dbd >2012-08-06 12:27:02,158 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-34) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 00efd7e6-aea7-44a2-85d7-6c59d7b18dbd), log id: 4955e6f8 >2012-08-06 12:27:02,165 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-34) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=00efd7e6-aea7-44a2-85d7-6c59d7b18dbd), log id: 5ce3a745 >2012-08-06 12:27:02,179 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-46) MacPoolManager::freeMac(mac = 00:1a:4a:23:61:68) - entered >2012-08-06 12:27:02,180 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) BaseAsyncTask::OnTaskEndSuccess: Task f11218cd-c338-42b4-b042-12926bb8c5a6 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 12:27:02,186 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 95b9258b-9b92-4b12-93fa-b5056b9176d9 has ended -> executing EndAction >2012-08-06 12:27:02,187 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 95b9258b-9b92-4b12-93fa-b5056b9176d9): calling EndAction for action type RemoveVm. >2012-08-06 12:27:02,192 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) MacPoolManager::freeMac(mac = 00:1a:4a:23:61:72) - entered >2012-08-06 12:27:02,190 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-46) Lock freed to object EngineLock [exclusiveLocks= key: 6a8ef0f6-c139-41d9-a814-60ca51daa5f4 value: VM >, sharedLocks= ] >2012-08-06 12:27:02,195 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction RemoveVm >2012-08-06 12:27:02,198 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) SPMAsyncTask::PollTask: Polling task 98e1baad-cbfa-4a15-92bb-0164a2d6e488 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 12:27:02,205 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-50) Lock freed to object EngineLock [exclusiveLocks= key: de370719-d4d0-4299-93d6-2fc4a274aa28 value: VM >, sharedLocks= ] >2012-08-06 12:27:02,200 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) SPMAsyncTask::ClearAsyncTask: Attempting to clear task c5d6fa56-13b9-41f1-ac65-6e49dbd6c65f >2012-08-06 12:27:02,211 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = c5d6fa56-13b9-41f1-ac65-6e49dbd6c65f), log id: 287b2396 >2012-08-06 12:27:02,247 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-34) FINISH, HSMClearTaskVDSCommand, log id: 5ce3a745 >2012-08-06 12:27:02,248 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-34) FINISH, SPMClearTaskVDSCommand, log id: 4955e6f8 >2012-08-06 12:27:02,249 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=c5d6fa56-13b9-41f1-ac65-6e49dbd6c65f), log id: 50f0842 >2012-08-06 12:27:02,269 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) BaseAsyncTask::OnTaskEndSuccess: Task 98e1baad-cbfa-4a15-92bb-0164a2d6e488 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 12:27:02,288 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 10ef6062-3141-48a6-a778-c79f7a47154e has ended -> executing EndAction >2012-08-06 12:27:02,289 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 10ef6062-3141-48a6-a778-c79f7a47154e): calling EndAction for action type RemoveVm. >2012-08-06 12:27:02,290 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction RemoveVm >2012-08-06 12:27:02,293 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) SPMAsyncTask::PollTask: Polling task 50df53c0-f39a-42ce-9f9f-4c9eb88b27f1 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 12:27:02,300 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2012-08-06 12:27:02,301 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-34) BaseAsyncTask::RemoveTaskFromDB: Removed task 00efd7e6-aea7-44a2-85d7-6c59d7b18dbd from DataBase >2012-08-06 12:27:02,302 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-34) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 66e09847-ee2c-4385-91d2-e7b698d53f85 >2012-08-06 12:27:02,304 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) Lock Acquired to object EngineLock [exclusiveLocks= key: 95b9258b-9b92-4b12-93fa-b5056b9176d9 value: VM >, sharedLocks= ] >2012-08-06 12:27:02,318 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-47) MacPoolManager::freeMac(mac = 00:1a:4a:23:61:70) - entered >2012-08-06 12:27:02,319 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) FINISH, HSMClearTaskVDSCommand, log id: 50f0842 >2012-08-06 12:27:02,322 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) FINISH, SPMClearTaskVDSCommand, log id: 287b2396 >2012-08-06 12:27:02,327 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-46) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2012-08-06 12:27:02,328 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-46) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2012-08-06 12:27:02,333 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2012-08-06 12:27:02,334 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2012-08-06 12:27:02,345 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) Lock freed to object EngineLock [exclusiveLocks= key: 95b9258b-9b92-4b12-93fa-b5056b9176d9 value: VM >, sharedLocks= ] >2012-08-06 12:27:02,368 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) BaseAsyncTask::OnTaskEndSuccess: Task 50df53c0-f39a-42ce-9f9f-4c9eb88b27f1 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 12:27:02,369 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) BaseAsyncTask::RemoveTaskFromDB: Removed task c5d6fa56-13b9-41f1-ac65-6e49dbd6c65f from DataBase >2012-08-06 12:27:02,370 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 3e4f0900-74f5-4b16-b6eb-f2c985ca4b94 >2012-08-06 12:27:02,378 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndActionIfNecessary: All tasks of entity c26afa24-84a3-4a85-939b-c8b0b293a8e9 has ended -> executing EndAction >2012-08-06 12:27:02,379 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: c26afa24-84a3-4a85-939b-c8b0b293a8e9): calling EndAction for action type RemoveVm. >2012-08-06 12:27:02,382 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction RemoveVm >2012-08-06 12:27:02,384 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) SPMAsyncTask::PollTask: Polling task 1ea919f1-f685-48f2-8b68-3b65011bb2f2 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 12:27:02,399 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-46) SPMAsyncTask::ClearAsyncTask: Attempting to clear task e5f69464-646c-4587-838f-942f066219de >2012-08-06 12:27:02,400 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-46) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = e5f69464-646c-4587-838f-942f066219de), log id: 54cfc1aa >2012-08-06 12:27:02,401 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task ddda46d3-5916-4886-a922-6790fe8be3fa >2012-08-06 12:27:02,407 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-50) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = ddda46d3-5916-4886-a922-6790fe8be3fa), log id: 27b1bb38 >2012-08-06 12:27:02,401 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-42) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2012-08-06 12:27:02,409 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-42) Lock Acquired to object EngineLock [exclusiveLocks= key: 10ef6062-3141-48a6-a778-c79f7a47154e value: VM >, sharedLocks= ] >2012-08-06 12:27:02,414 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-50) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=ddda46d3-5916-4886-a922-6790fe8be3fa), log id: 26021b83 >2012-08-06 12:27:02,420 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-42) MacPoolManager::freeMac(mac = 00:1a:4a:23:61:63) - entered >2012-08-06 12:27:02,429 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-42) Lock freed to object EngineLock [exclusiveLocks= key: 10ef6062-3141-48a6-a778-c79f7a47154e value: VM >, sharedLocks= ] >2012-08-06 12:27:02,448 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) BaseAsyncTask::OnTaskEndSuccess: Task 1ea919f1-f685-48f2-8b68-3b65011bb2f2 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 12:27:02,452 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 has ended -> executing EndAction >2012-08-06 12:27:02,457 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4): calling EndAction for action type RemoveVm. >2012-08-06 12:27:02,460 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-34) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction RemoveVm >2012-08-06 12:27:02,469 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) SPMAsyncTask::PollTask: Polling task 4a3e7d3b-622b-406a-9245-6797e1199841 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 12:27:02,478 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2012-08-06 12:27:02,483 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2012-08-06 12:27:02,473 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 26021b83 >2012-08-06 12:27:02,484 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 27b1bb38 >2012-08-06 12:27:02,487 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-46) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=e5f69464-646c-4587-838f-942f066219de), log id: 11f968ee >2012-08-06 12:27:02,492 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-44) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2012-08-06 12:27:02,492 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-44) Lock Acquired to object EngineLock [exclusiveLocks= key: c26afa24-84a3-4a85-939b-c8b0b293a8e9 value: VM >, sharedLocks= ] >2012-08-06 12:27:02,493 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-34) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2012-08-06 12:27:02,496 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-34) Lock Acquired to object EngineLock [exclusiveLocks= key: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 value: VM >, sharedLocks= ] >2012-08-06 12:27:02,513 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2012-08-06 12:27:02,514 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2012-08-06 12:27:02,515 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) SPMAsyncTask::ClearAsyncTask: Attempting to clear task f11218cd-c338-42b4-b042-12926bb8c5a6 >2012-08-06 12:27:02,514 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task ddda46d3-5916-4886-a922-6790fe8be3fa from DataBase >2012-08-06 12:27:02,518 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity de370719-d4d0-4299-93d6-2fc4a274aa28 >2012-08-06 12:27:02,519 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-47) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = f11218cd-c338-42b4-b042-12926bb8c5a6), log id: dad9386 >2012-08-06 12:27:02,528 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) BaseAsyncTask::OnTaskEndSuccess: Task 4a3e7d3b-622b-406a-9245-6797e1199841 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 12:27:02,524 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-44) MacPoolManager::freeMac(mac = 00:1a:4a:23:61:5d) - entered >2012-08-06 12:27:02,532 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-44) Lock freed to object EngineLock [exclusiveLocks= key: c26afa24-84a3-4a85-939b-c8b0b293a8e9 value: VM >, sharedLocks= ] >2012-08-06 12:27:02,544 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-42) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 98e1baad-cbfa-4a15-92bb-0164a2d6e488 >2012-08-06 12:27:02,545 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-42) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 98e1baad-cbfa-4a15-92bb-0164a2d6e488), log id: 72d3cb4a >2012-08-06 12:27:02,547 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3 has ended -> executing EndAction >2012-08-06 12:27:02,550 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3): calling EndAction for action type RemoveVm. >2012-08-06 12:27:02,546 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-34) MacPoolManager::freeMac(mac = 00:1a:4a:23:61:67) - entered >2012-08-06 12:27:02,556 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction RemoveVm >2012-08-06 12:27:02,557 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) SPMAsyncTask::PollTask: Polling task ca5dbd79-1565-46db-9500-23314f2994c8 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 12:27:02,570 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-34) Lock freed to object EngineLock [exclusiveLocks= key: 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 value: VM >, sharedLocks= ] >2012-08-06 12:27:02,583 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) BaseAsyncTask::OnTaskEndSuccess: Task ca5dbd79-1565-46db-9500-23314f2994c8 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 12:27:02,589 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 4dfd7e9a-0245-403d-8fe6-f415f61121af has ended -> executing EndAction >2012-08-06 12:27:02,592 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2012-08-06 12:27:02,601 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2012-08-06 12:27:02,603 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-50) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2012-08-06 12:27:02,603 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-50) Lock Acquired to object EngineLock [exclusiveLocks= key: 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3 value: VM >, sharedLocks= ] >2012-08-06 12:27:02,609 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 4dfd7e9a-0245-403d-8fe6-f415f61121af): calling EndAction for action type RemoveVm. >2012-08-06 12:27:02,612 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-46) FINISH, HSMClearTaskVDSCommand, log id: 11f968ee >2012-08-06 12:27:02,614 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-46) FINISH, SPMClearTaskVDSCommand, log id: 54cfc1aa >2012-08-06 12:27:02,616 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-42) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=98e1baad-cbfa-4a15-92bb-0164a2d6e488), log id: 13aaf968 >2012-08-06 12:27:02,619 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-43) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction RemoveVm >2012-08-06 12:27:02,627 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) MacPoolManager::freeMac(mac = 00:1a:4a:23:61:66) - entered >2012-08-06 12:27:02,628 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 50df53c0-f39a-42ce-9f9f-4c9eb88b27f1 >2012-08-06 12:27:02,629 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 50df53c0-f39a-42ce-9f9f-4c9eb88b27f1), log id: 78da37a6 >2012-08-06 12:27:02,633 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-50) Lock freed to object EngineLock [exclusiveLocks= key: 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3 value: VM >, sharedLocks= ] >2012-08-06 12:27:02,648 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-46) BaseAsyncTask::RemoveTaskFromDB: Removed task e5f69464-646c-4587-838f-942f066219de from DataBase >2012-08-06 12:27:02,649 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-46) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 6a8ef0f6-c139-41d9-a814-60ca51daa5f4 >2012-08-06 12:27:02,674 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-34) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2012-08-06 12:27:02,674 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-34) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2012-08-06 12:27:02,694 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2012-08-06 12:27:02,698 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2012-08-06 12:27:02,702 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-34) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 1ea919f1-f685-48f2-8b68-3b65011bb2f2 >2012-08-06 12:27:02,703 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-34) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 1ea919f1-f685-48f2-8b68-3b65011bb2f2), log id: 3ff7dac6 >2012-08-06 12:27:02,704 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-43) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2012-08-06 12:27:02,706 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-43) Lock Acquired to object EngineLock [exclusiveLocks= key: 4dfd7e9a-0245-403d-8fe6-f415f61121af value: VM >, sharedLocks= ] >2012-08-06 12:27:02,708 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-42) FINISH, HSMClearTaskVDSCommand, log id: 13aaf968 >2012-08-06 12:27:02,708 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-42) FINISH, SPMClearTaskVDSCommand, log id: 72d3cb4a >2012-08-06 12:27:02,710 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-47) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=f11218cd-c338-42b4-b042-12926bb8c5a6), log id: 60952b7f >2012-08-06 12:27:02,718 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 4a3e7d3b-622b-406a-9245-6797e1199841 >2012-08-06 12:27:02,726 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-50) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 4a3e7d3b-622b-406a-9245-6797e1199841), log id: 967dda1 >2012-08-06 12:27:02,729 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-43) MacPoolManager::freeMac(mac = 00:1a:4a:23:61:64) - entered >2012-08-06 12:27:02,728 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-42) BaseAsyncTask::RemoveTaskFromDB: Removed task 98e1baad-cbfa-4a15-92bb-0164a2d6e488 from DataBase >2012-08-06 12:27:02,736 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 10ef6062-3141-48a6-a778-c79f7a47154e >2012-08-06 12:27:02,739 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-43) Lock freed to object EngineLock [exclusiveLocks= key: 4dfd7e9a-0245-403d-8fe6-f415f61121af value: VM >, sharedLocks= ] >2012-08-06 12:27:02,774 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-47) FINISH, HSMClearTaskVDSCommand, log id: 60952b7f >2012-08-06 12:27:02,774 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-47) FINISH, SPMClearTaskVDSCommand, log id: dad9386 >2012-08-06 12:27:02,776 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-50) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=4a3e7d3b-622b-406a-9245-6797e1199841), log id: 29ba21f5 >2012-08-06 12:27:02,834 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 29ba21f5 >2012-08-06 12:27:02,835 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 967dda1 >2012-08-06 12:27:02,838 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-34) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=1ea919f1-f685-48f2-8b68-3b65011bb2f2), log id: 6c51e889 >2012-08-06 12:27:02,841 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-43) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2012-08-06 12:27:02,843 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-43) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2012-08-06 12:27:02,855 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) BaseAsyncTask::RemoveTaskFromDB: Removed task f11218cd-c338-42b4-b042-12926bb8c5a6 from DataBase >2012-08-06 12:27:02,856 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 95b9258b-9b92-4b12-93fa-b5056b9176d9 >2012-08-06 12:27:02,856 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task 4a3e7d3b-622b-406a-9245-6797e1199841 from DataBase >2012-08-06 12:27:02,859 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 4cbfdd02-5a56-4fb0-9bea-84d53aa3f6b3 >2012-08-06 12:27:02,867 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-43) SPMAsyncTask::ClearAsyncTask: Attempting to clear task ca5dbd79-1565-46db-9500-23314f2994c8 >2012-08-06 12:27:02,868 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-43) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = ca5dbd79-1565-46db-9500-23314f2994c8), log id: 6cc0d695 >2012-08-06 12:27:02,902 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-34) FINISH, HSMClearTaskVDSCommand, log id: 6c51e889 >2012-08-06 12:27:02,902 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-34) FINISH, SPMClearTaskVDSCommand, log id: 3ff7dac6 >2012-08-06 12:27:02,905 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=50df53c0-f39a-42ce-9f9f-4c9eb88b27f1), log id: cec64b3 >2012-08-06 12:27:02,917 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-34) BaseAsyncTask::RemoveTaskFromDB: Removed task 1ea919f1-f685-48f2-8b68-3b65011bb2f2 from DataBase >2012-08-06 12:27:02,918 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-34) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 3c5452c9-a5e2-46af-90b5-b568da5dc3d4 >2012-08-06 12:27:02,952 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) FINISH, HSMClearTaskVDSCommand, log id: cec64b3 >2012-08-06 12:27:02,953 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) FINISH, SPMClearTaskVDSCommand, log id: 78da37a6 >2012-08-06 12:27:02,955 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-43) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=ca5dbd79-1565-46db-9500-23314f2994c8), log id: 60fb2830 >2012-08-06 12:27:02,972 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) BaseAsyncTask::RemoveTaskFromDB: Removed task 50df53c0-f39a-42ce-9f9f-4c9eb88b27f1 from DataBase >2012-08-06 12:27:02,973 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity c26afa24-84a3-4a85-939b-c8b0b293a8e9 >2012-08-06 12:27:02,994 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-43) FINISH, HSMClearTaskVDSCommand, log id: 60fb2830 >2012-08-06 12:27:02,994 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-43) FINISH, SPMClearTaskVDSCommand, log id: 6cc0d695 >2012-08-06 12:27:03,031 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-43) BaseAsyncTask::RemoveTaskFromDB: Removed task ca5dbd79-1565-46db-9500-23314f2994c8 from DataBase >2012-08-06 12:27:03,034 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-43) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 4dfd7e9a-0245-403d-8fe6-f415f61121af >2012-08-06 12:27:07,429 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8009-12) Lock Acquired to object EngineLock [exclusiveLocks= key: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 value: VM >, sharedLocks= ] >2012-08-06 12:27:07,438 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-12) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 9c5e88 >2012-08-06 12:27:07,442 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-12) FINISH, IsValidVDSCommand, return: true, log id: 9c5e88 >2012-08-06 12:27:07,506 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-12) START, IsVmDuringInitiatingVDSCommand(vmId = 54b872c6-cefc-4a19-b48e-9bc1a09285f9), log id: 6834b728 >2012-08-06 12:27:07,507 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-12) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 6834b728 >2012-08-06 12:27:07,633 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-34) [1f5f3b16] Running command: RunVmCommand internal: false. Entities affected : ID: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 Type: VM >2012-08-06 12:27:07,644 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-34) [1f5f3b16] Cant find VDS to run the VM 54b872c6-cefc-4a19-b48e-9bc1a09285f9 on, so this VM will not be run. >2012-08-06 12:27:07,665 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-34) [1f5f3b16] Lock freed to object EngineLock [exclusiveLocks= key: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 value: VM >, sharedLocks= ] >2012-08-06 12:27:35,397 INFO [org.ovirt.engine.core.bll.MaintananceNumberOfVdssCommand] (pool-3-thread-43) [28cb0434] Running command: MaintananceNumberOfVdssCommand internal: false. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 12:27:35,399 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-43) [28cb0434] START, SetVdsStatusVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, status=PreparingForMaintenance, nonOperationalReason=NONE), log id: 78d2de32 >2012-08-06 12:27:35,453 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-43) [28cb0434] FINISH, SetVdsStatusVDSCommand, log id: 78d2de32 >2012-08-06 12:27:35,511 INFO [org.ovirt.engine.core.bll.MaintananceVdsCommand] (pool-3-thread-43) [37818211] Running command: MaintananceVdsCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 12:27:36,969 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-41) vds::Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3 >2012-08-06 12:27:37,042 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) Clearing cache of pool: 66f96b6e-dee5-11e1-a6fd-f39cbdf23023 for problematic entities of VDS: purple-vds3. >2012-08-06 12:27:45,269 INFO [org.ovirt.engine.core.bll.ChangeVDSClusterCommand] (ajp--127.0.0.1-8009-10) [e6ef019] Running command: ChangeVDSClusterCommand internal: false. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS, ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups >2012-08-06 12:27:45,297 INFO [org.ovirt.engine.core.bll.RemoveVdsSpmIdCommand] (ajp--127.0.0.1-8009-10) [e6ef019] Running command: RemoveVdsSpmIdCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 12:27:45,334 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp--127.0.0.1-8009-10) [e6ef019] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 12:27:45,357 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp--127.0.0.1-8009-10) [e6ef019] Lock freed to object EngineLock [exclusiveLocks= key: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f value: REGISTER_VDS >, sharedLocks= ] >2012-08-06 12:27:45,396 INFO [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp--127.0.0.1-8009-2) [8b3d3b9] Running command: UpdateVdsCommand internal: false. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 12:27:46,194 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp--127.0.0.1-8009-12) Lock Acquired to object EngineLock [exclusiveLocks= key: 47028088-dee6-11e1-bffa-2f8f15de3134 value: VDS >, sharedLocks= ] >2012-08-06 12:27:46,331 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-3-thread-34) [2092db51] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 12:27:46,380 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-34) [2092db51] START, SetVdsStatusVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, status=Unassigned, nonOperationalReason=NONE), log id: 1667dfac >2012-08-06 12:27:46,387 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-34) [2092db51] FINISH, SetVdsStatusVDSCommand, log id: 1667dfac >2012-08-06 12:27:46,402 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (pool-3-thread-34) [2092db51] START, ActivateVdsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134), log id: 1aa2ba02 >2012-08-06 12:27:46,738 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (pool-3-thread-34) [4d15fc8] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 12:27:46,750 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (pool-3-thread-34) [1119c2a0] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 12:27:46,765 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (pool-3-thread-34) [1119c2a0] FINISH, ActivateVdsVDSCommand, log id: 1aa2ba02 >2012-08-06 12:27:46,803 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-3-thread-34) [1119c2a0] Lock freed to object EngineLock [exclusiveLocks= key: 47028088-dee6-11e1-bffa-2f8f15de3134 value: VDS >, sharedLocks= ] >2012-08-06 12:27:47,581 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-71) [4650afe9] Running command: InitVdsOnUpCommand internal: true. >2012-08-06 12:27:47,692 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (QuartzScheduler_Worker-71) [3fc3d55b] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, storageType = NFS, connectionList = [{ id: f6121783-5d14-493d-a12e-9b31402f985b, connection: orion.qa.lab.tlv.redhat.com:/export/lesik };]), log id: 35a95551 >2012-08-06 12:27:47,725 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (QuartzScheduler_Worker-71) [3fc3d55b] FINISH, ValidateStorageServerConnectionVDSCommand, return: {f6121783-5d14-493d-a12e-9b31402f985b=0}, log id: 35a95551 >2012-08-06 12:27:47,727 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-71) [3fc3d55b] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-06 12:27:47,730 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-71) [3fc3d55b] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, storageType = NFS, connectionList = [{ id: f6121783-5d14-493d-a12e-9b31402f985b, connection: orion.qa.lab.tlv.redhat.com:/export/lesik };]), log id: 474e2ed7 >2012-08-06 12:27:48,050 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-71) [3fc3d55b] FINISH, ConnectStorageServerVDSCommand, return: {f6121783-5d14-493d-a12e-9b31402f985b=0}, log id: 474e2ed7 >2012-08-06 12:27:48,051 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-71) [3fc3d55b] Host purple-vds3 storage connection was succeeded >2012-08-06 12:27:48,074 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-71) [3fc3d55b] START, ConnectStoragePoolVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, vds_spm_id = 2, masterDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, masterVersion = 1), log id: 7faf6d27 >2012-08-06 12:27:49,299 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-71) [3fc3d55b] FINISH, ConnectStoragePoolVDSCommand, log id: 7faf6d27 >2012-08-06 12:27:49,306 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-71) [3fc3d55b] No string for UNASSIGNED type. Use default Log >2012-08-06 12:27:49,310 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-34) [3fc3d55b] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-08-06 12:27:49,333 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-71) [7e18b87e] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 12:27:49,349 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-71) [492aac78] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 12:27:51,237 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8009-9) Lock Acquired to object EngineLock [exclusiveLocks= key: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 value: VM >, sharedLocks= ] >2012-08-06 12:27:51,249 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-9) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 680ff213 >2012-08-06 12:27:51,251 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-9) FINISH, IsValidVDSCommand, return: true, log id: 680ff213 >2012-08-06 12:27:51,295 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-9) START, IsVmDuringInitiatingVDSCommand(vmId = 54b872c6-cefc-4a19-b48e-9bc1a09285f9), log id: 570446b2 >2012-08-06 12:27:51,296 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-9) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 570446b2 >2012-08-06 12:27:51,380 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-34) [28792c12] Running command: RunVmCommand internal: false. Entities affected : ID: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 Type: VM >2012-08-06 12:27:51,398 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-34) [28792c12] Cant find VDS to run the VM 54b872c6-cefc-4a19-b48e-9bc1a09285f9 on, so this VM will not be run. >2012-08-06 12:27:51,429 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-34) [28792c12] Lock freed to object EngineLock [exclusiveLocks= key: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 value: VM >, sharedLocks= ] >2012-08-06 12:27:56,248 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8009-8) Lock Acquired to object EngineLock [exclusiveLocks= key: ba81adbe-b311-4aef-b6c1-5f84f0f3c94d value: VM >, sharedLocks= ] >2012-08-06 12:27:56,255 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-8) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 254b4a8b >2012-08-06 12:27:56,259 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-8) FINISH, IsValidVDSCommand, return: true, log id: 254b4a8b >2012-08-06 12:27:56,292 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-8) START, IsVmDuringInitiatingVDSCommand(vmId = ba81adbe-b311-4aef-b6c1-5f84f0f3c94d), log id: 65b760d4 >2012-08-06 12:27:56,293 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-8) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 65b760d4 >2012-08-06 12:27:56,368 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-44) [4a7d596a] Running command: RunVmCommand internal: false. Entities affected : ID: ba81adbe-b311-4aef-b6c1-5f84f0f3c94d Type: VM >2012-08-06 12:27:56,386 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-44) [4a7d596a] Cant find VDS to run the VM ba81adbe-b311-4aef-b6c1-5f84f0f3c94d on, so this VM will not be run. >2012-08-06 12:27:56,401 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-44) [4a7d596a] Lock freed to object EngineLock [exclusiveLocks= key: ba81adbe-b311-4aef-b6c1-5f84f0f3c94d value: VM >, sharedLocks= ] >2012-08-06 12:27:56,865 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-73) Setting new tasks map. The map contains now 12 tasks >2012-08-06 12:28:02,871 INFO [org.ovirt.engine.core.bll.MaintananceNumberOfVdssCommand] (pool-3-thread-44) [611c82be] Running command: MaintananceNumberOfVdssCommand internal: false. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 12:28:02,873 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-44) [611c82be] START, SetVdsStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, status=PreparingForMaintenance, nonOperationalReason=NONE), log id: ad8217b >2012-08-06 12:28:02,912 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-44) [611c82be] SetVdsStatusVDSCommand::VSD purple-vds2 is spm and moved from up calling ResetIrs. >2012-08-06 12:28:02,915 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (pool-3-thread-44) [611c82be] START, ResetIrsVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, hostName = purple-vds2, vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, ignoreStopFailed = false), log id: 7edb47e3 >2012-08-06 12:28:02,929 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-3-thread-44) [611c82be] START, SpmStopVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f), log id: 5872f615 >2012-08-06 12:28:02,958 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-3-thread-44) [611c82be] SpmStopVDSCommand::Stopping SPM on vds purple-vds2, pool id efe20197-e0a7-49b8-beb4-19b1ed3f8c3f >2012-08-06 12:28:03,114 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-3-thread-44) [611c82be] FINISH, SpmStopVDSCommand, log id: 5872f615 >2012-08-06 12:28:03,130 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (pool-3-thread-44) [611c82be] FINISH, ResetIrsVDSCommand, log id: 7edb47e3 >2012-08-06 12:28:03,133 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-44) [611c82be] FINISH, SetVdsStatusVDSCommand, log id: ad8217b >2012-08-06 12:28:03,208 INFO [org.ovirt.engine.core.bll.MaintananceVdsCommand] (pool-3-thread-44) [1d83d21e] Running command: MaintananceVdsCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 12:28:03,640 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-93) vds::Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 4196a566-dee6-11e1-b66e-c35c5273fee7 : purple-vds2 >2012-08-06 12:28:03,699 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) Clearing cache of pool: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f for problematic entities of VDS: purple-vds2. >2012-08-06 12:28:03,705 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (QuartzScheduler_Worker-93) START, DisconnectStoragePoolVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, vds_spm_id = 1, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 0), log id: 6b432873 >2012-08-06 12:28:05,737 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (QuartzScheduler_Worker-93) FINISH, DisconnectStoragePoolVDSCommand, log id: 6b432873 >2012-08-06 12:28:05,743 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (QuartzScheduler_Worker-93) [33192247] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-06 12:28:05,787 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (QuartzScheduler_Worker-93) [33192247] START, DisconnectStorageServerVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, storageType = NFS, connectionList = [{ id: f6121783-5d14-493d-a12e-9b31402f985b, connection: orion.qa.lab.tlv.redhat.com:/export/lesik };]), log id: 57c9d929 >2012-08-06 12:28:08,073 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (QuartzScheduler_Worker-93) [33192247] FINISH, DisconnectStorageServerVDSCommand, return: {f6121783-5d14-493d-a12e-9b31402f985b=0}, log id: 57c9d929 >2012-08-06 12:28:12,500 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-11) [75851403] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-06 12:28:12,589 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) [75851403] hostFromVds::selectedVds - purple-vds3, spmStatus Free, storage pool nfs31 >2012-08-06 12:28:12,612 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) [75851403] SPM Init: could not find reported vds or not up - pool:nfs31 vds_spm_id: 1 >2012-08-06 12:28:12,616 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) [75851403] SPM selection - vds seems as spm purple-vds2 >2012-08-06 12:28:12,620 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-11) [75851403] START, SpmStopVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f), log id: 2f024941 >2012-08-06 12:28:12,647 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-11) [75851403] SpmStopVDSCommand::Stopping SPM on vds purple-vds2, pool id efe20197-e0a7-49b8-beb4-19b1ed3f8c3f >2012-08-06 12:28:12,676 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-11) [75851403] FINISH, SpmStopVDSCommand, log id: 2f024941 >2012-08-06 12:28:12,677 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) [75851403] spm stop succeeded, continuing with spm selection >2012-08-06 12:28:12,710 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) [75851403] starting spm on vds purple-vds3, storage pool nfs31, prevId 1, LVER 0 >2012-08-06 12:28:12,715 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [75851403] START, SpmStartVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, prevId=1, prevLVER=0, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=true), log id: c13b4af >2012-08-06 12:28:12,745 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [75851403] spmStart polling started: taskId = 02a5b87c-f1f1-4f9b-8b51-8a2eb74b94b7 >2012-08-06 12:28:13,768 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [75851403] spmStart polling ended: taskId = 02a5b87c-f1f1-4f9b-8b51-8a2eb74b94b7 task status = finished >2012-08-06 12:28:13,788 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [75851403] spmStart polling ended. spm status: SPM >2012-08-06 12:28:13,790 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-11) [75851403] START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=02a5b87c-f1f1-4f9b-8b51-8a2eb74b94b7), log id: cb5278 >2012-08-06 12:28:13,815 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-11) [75851403] FINISH, HSMClearTaskVDSCommand, log id: cb5278 >2012-08-06 12:28:13,816 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [75851403] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@249344b0, log id: c13b4af >2012-08-06 12:28:13,830 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) [75851403] Initialize Irs proxy from vds: purple-vds3 >2012-08-06 12:28:13,935 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-28) Attempting to get and stop tasks on storage pool nfs31 >2012-08-06 12:28:13,937 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-28) START, SPMGetAllTasksInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1279968d >2012-08-06 12:28:14,072 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-28) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool efe20197-e0a7-49b8-beb4-19b1ed3f8c3f >2012-08-06 12:28:14,076 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-28) START, HSMGetAllTasksInfoVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134), log id: 50ff690e >2012-08-06 12:28:14,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-28) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 50ff690e >2012-08-06 12:28:14,100 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-28) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 1279968d >2012-08-06 12:28:14,101 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-28) Discovered no tasks on Storage Pool nfs31 >2012-08-06 12:28:14,104 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-28) START, SPMGetAllTasksInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 124ac2fd >2012-08-06 12:28:14,109 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-28) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool efe20197-e0a7-49b8-beb4-19b1ed3f8c3f >2012-08-06 12:28:14,114 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-28) START, HSMGetAllTasksInfoVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134), log id: 38ac9951 >2012-08-06 12:28:14,138 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-28) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 38ac9951 >2012-08-06 12:28:14,139 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-28) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 124ac2fd >2012-08-06 12:28:14,140 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-28) Discovered no tasks on Storage Pool nfs31 >2012-08-06 12:28:19,379 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8009-1) Lock Acquired to object EngineLock [exclusiveLocks= key: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 value: VM >, sharedLocks= ] >2012-08-06 12:28:19,384 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-1) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 36999ff2 >2012-08-06 12:28:19,386 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-1) FINISH, IsValidVDSCommand, return: true, log id: 36999ff2 >2012-08-06 12:28:19,450 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-1) START, IsVmDuringInitiatingVDSCommand(vmId = 54b872c6-cefc-4a19-b48e-9bc1a09285f9), log id: 7ac5ad27 >2012-08-06 12:28:19,451 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-1) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 7ac5ad27 >2012-08-06 12:28:19,567 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-34) [4e494f43] Running command: RunVmCommand internal: false. Entities affected : ID: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 Type: VM >2012-08-06 12:28:19,575 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-34) [4e494f43] Cant find VDS to run the VM 54b872c6-cefc-4a19-b48e-9bc1a09285f9 on, so this VM will not be run. >2012-08-06 12:28:19,606 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-34) [4e494f43] Lock freed to object EngineLock [exclusiveLocks= key: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 value: VM >, sharedLocks= ] >2012-08-06 12:28:26,866 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-9) Setting new tasks map. The map contains now 0 tasks >2012-08-06 12:28:26,867 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-9) Cleared all tasks of pool efe20197-e0a7-49b8-beb4-19b1ed3f8c3f. >2012-08-06 12:28:26,870 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-9) Could not find vds that is spm and non-operational. >2012-08-06 12:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts >2012-08-06 12:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering 0 hosts >2012-08-06 12:30:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts done >2012-08-06 12:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable storage domains >2012-08-06 12:30:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering 0 storage domains >2012-08-06 12:30:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable storage domains done >2012-08-06 12:32:42,235 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp--127.0.0.1-8009-6) Lock Acquired to object EngineLock [exclusiveLocks= key: 4196a566-dee6-11e1-b66e-c35c5273fee7 value: VDS >, sharedLocks= ] >2012-08-06 12:32:42,301 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-3-thread-43) [354fba76] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 12:32:42,331 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-43) [354fba76] START, SetVdsStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, status=Unassigned, nonOperationalReason=NONE), log id: 553b4c7b >2012-08-06 12:32:42,338 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-43) [354fba76] FINISH, SetVdsStatusVDSCommand, log id: 553b4c7b >2012-08-06 12:32:42,353 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (pool-3-thread-43) [354fba76] START, ActivateVdsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7), log id: 45508e09 >2012-08-06 12:32:42,674 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (pool-3-thread-43) [4fcf5d9a] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 12:32:42,681 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (pool-3-thread-43) [16169cb6] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 12:32:42,689 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (pool-3-thread-43) [16169cb6] FINISH, ActivateVdsVDSCommand, log id: 45508e09 >2012-08-06 12:32:42,749 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-3-thread-43) [16169cb6] Lock freed to object EngineLock [exclusiveLocks= key: 4196a566-dee6-11e1-b66e-c35c5273fee7 value: VDS >, sharedLocks= ] >2012-08-06 12:32:43,040 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-70) [2dd1ee4b] Running command: InitVdsOnUpCommand internal: true. >2012-08-06 12:32:43,116 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (QuartzScheduler_Worker-70) [55a3a4ea] START, ValidateStorageServerConnectionVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, storageType = NFS, connectionList = [{ id: f6121783-5d14-493d-a12e-9b31402f985b, connection: orion.qa.lab.tlv.redhat.com:/export/lesik };]), log id: 77539cce >2012-08-06 12:32:43,142 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (QuartzScheduler_Worker-70) [55a3a4ea] FINISH, ValidateStorageServerConnectionVDSCommand, return: {f6121783-5d14-493d-a12e-9b31402f985b=0}, log id: 77539cce >2012-08-06 12:32:43,143 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-70) [55a3a4ea] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-06 12:32:43,149 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-70) [55a3a4ea] START, ConnectStorageServerVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, storageType = NFS, connectionList = [{ id: f6121783-5d14-493d-a12e-9b31402f985b, connection: orion.qa.lab.tlv.redhat.com:/export/lesik };]), log id: 1ec084a6 >2012-08-06 12:32:43,219 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-70) [55a3a4ea] FINISH, ConnectStorageServerVDSCommand, return: {f6121783-5d14-493d-a12e-9b31402f985b=0}, log id: 1ec084a6 >2012-08-06 12:32:43,220 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-70) [55a3a4ea] Host purple-vds2 storage connection was succeeded >2012-08-06 12:32:43,249 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-70) [55a3a4ea] START, ConnectStoragePoolVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, vds_spm_id = 1, masterDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, masterVersion = 1), log id: 1f1c8715 >2012-08-06 12:32:45,477 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-70) [55a3a4ea] FINISH, ConnectStoragePoolVDSCommand, log id: 1f1c8715 >2012-08-06 12:32:45,483 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-70) [55a3a4ea] No string for UNASSIGNED type. Use default Log >2012-08-06 12:32:45,487 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-34) [55a3a4ea] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-08-06 12:32:45,519 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-70) [463a6271] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 12:32:45,532 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-70) [4a4231ea] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 12:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable hosts >2012-08-06 12:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Autorecovering 0 hosts >2012-08-06 12:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable hosts done >2012-08-06 12:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable storage domains >2012-08-06 12:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Autorecovering 0 storage domains >2012-08-06 12:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable storage domains done >2012-08-06 12:37:22,976 INFO [org.ovirt.engine.core.bll.MaintananceNumberOfVdssCommand] (pool-3-thread-43) [3c398d84] Running command: MaintananceNumberOfVdssCommand internal: false. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 12:37:22,981 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-43) [3c398d84] START, SetVdsStatusVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, status=PreparingForMaintenance, nonOperationalReason=NONE), log id: 829c43b >2012-08-06 12:37:23,038 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-43) [3c398d84] SetVdsStatusVDSCommand::VSD purple-vds3 is spm and moved from up calling ResetIrs. >2012-08-06 12:37:23,039 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (pool-3-thread-43) [3c398d84] START, ResetIrsVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, hostName = purple-vds3, vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, ignoreStopFailed = false), log id: 6a9069c1 >2012-08-06 12:37:23,047 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-3-thread-43) [3c398d84] START, SpmStopVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f), log id: 68bc44d3 >2012-08-06 12:37:23,072 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-3-thread-43) [3c398d84] SpmStopVDSCommand::Stopping SPM on vds purple-vds3, pool id efe20197-e0a7-49b8-beb4-19b1ed3f8c3f >2012-08-06 12:37:23,324 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-3-thread-43) [3c398d84] FINISH, SpmStopVDSCommand, log id: 68bc44d3 >2012-08-06 12:37:23,339 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (pool-3-thread-43) [3c398d84] FINISH, ResetIrsVDSCommand, log id: 6a9069c1 >2012-08-06 12:37:23,342 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-43) [3c398d84] FINISH, SetVdsStatusVDSCommand, log id: 829c43b >2012-08-06 12:37:23,422 INFO [org.ovirt.engine.core.bll.MaintananceVdsCommand] (pool-3-thread-43) [5db83831] Running command: MaintananceVdsCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 12:37:24,347 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-15) vds::Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3 >2012-08-06 12:37:24,424 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-15) Clearing cache of pool: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f for problematic entities of VDS: purple-vds3. >2012-08-06 12:37:24,430 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (QuartzScheduler_Worker-15) START, DisconnectStoragePoolVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, vds_spm_id = 2, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 0), log id: 10e8a3c2 >2012-08-06 12:37:27,463 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (QuartzScheduler_Worker-15) FINISH, DisconnectStoragePoolVDSCommand, log id: 10e8a3c2 >2012-08-06 12:37:27,473 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (QuartzScheduler_Worker-15) [226d84bb] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-06 12:37:27,504 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (QuartzScheduler_Worker-15) [226d84bb] START, DisconnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, storageType = NFS, connectionList = [{ id: f6121783-5d14-493d-a12e-9b31402f985b, connection: orion.qa.lab.tlv.redhat.com:/export/lesik };]), log id: 6a9ddbbd >2012-08-06 12:37:28,220 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (QuartzScheduler_Worker-15) [226d84bb] FINISH, DisconnectStorageServerVDSCommand, return: {f6121783-5d14-493d-a12e-9b31402f985b=0}, log id: 6a9ddbbd >2012-08-06 12:37:29,135 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp--127.0.0.1-8009-7) Lock Acquired to object EngineLock [exclusiveLocks= key: 47028088-dee6-11e1-bffa-2f8f15de3134 value: VDS >, sharedLocks= ] >2012-08-06 12:37:29,208 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-3-thread-43) [7a74c314] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 12:37:29,259 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-43) [7a74c314] START, SetVdsStatusVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, status=Unassigned, nonOperationalReason=NONE), log id: 5fa8f891 >2012-08-06 12:37:29,266 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-43) [7a74c314] FINISH, SetVdsStatusVDSCommand, log id: 5fa8f891 >2012-08-06 12:37:29,299 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (pool-3-thread-43) [7a74c314] START, ActivateVdsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134), log id: 580c9dc5 >2012-08-06 12:37:29,925 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (pool-3-thread-43) [55f76e94] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 12:37:29,936 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (pool-3-thread-43) [2c50c33b] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 12:37:29,941 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (pool-3-thread-43) [2c50c33b] FINISH, ActivateVdsVDSCommand, log id: 580c9dc5 >2012-08-06 12:37:30,008 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-3-thread-43) [2c50c33b] Lock freed to object EngineLock [exclusiveLocks= key: 47028088-dee6-11e1-bffa-2f8f15de3134 value: VDS >, sharedLocks= ] >2012-08-06 12:37:30,640 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-48) [36dac532] Running command: InitVdsOnUpCommand internal: true. >2012-08-06 12:37:30,707 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (QuartzScheduler_Worker-48) [17b0a56e] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, storageType = NFS, connectionList = [{ id: f6121783-5d14-493d-a12e-9b31402f985b, connection: orion.qa.lab.tlv.redhat.com:/export/lesik };]), log id: 1c797ee3 >2012-08-06 12:37:30,729 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (QuartzScheduler_Worker-48) [17b0a56e] FINISH, ValidateStorageServerConnectionVDSCommand, return: {f6121783-5d14-493d-a12e-9b31402f985b=0}, log id: 1c797ee3 >2012-08-06 12:37:30,730 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-48) [17b0a56e] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-06 12:37:30,736 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-48) [17b0a56e] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, storageType = NFS, connectionList = [{ id: f6121783-5d14-493d-a12e-9b31402f985b, connection: orion.qa.lab.tlv.redhat.com:/export/lesik };]), log id: 38aae800 >2012-08-06 12:37:30,805 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-48) [17b0a56e] FINISH, ConnectStorageServerVDSCommand, return: {f6121783-5d14-493d-a12e-9b31402f985b=0}, log id: 38aae800 >2012-08-06 12:37:30,806 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-48) [17b0a56e] Host purple-vds3 storage connection was succeeded >2012-08-06 12:37:30,832 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-48) [17b0a56e] START, ConnectStoragePoolVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, vds_spm_id = 2, masterDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, masterVersion = 1), log id: 5542a7a0 >2012-08-06 12:37:31,616 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-74) [840bf70] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-06 12:37:31,706 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [840bf70] hostFromVds::selectedVds - purple-vds2, spmStatus Free, storage pool nfs31 >2012-08-06 12:37:31,728 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [840bf70] SPM Init: could not find reported vds or not up - pool:nfs31 vds_spm_id: 2 >2012-08-06 12:37:31,730 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [840bf70] SPM selection - vds seems as spm purple-vds3 >2012-08-06 12:37:31,734 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-74) [840bf70] START, SpmStopVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f), log id: 3372d620 >2012-08-06 12:37:31,750 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-48) [17b0a56e] FINISH, ConnectStoragePoolVDSCommand, log id: 5542a7a0 >2012-08-06 12:37:31,759 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-48) [17b0a56e] No string for UNASSIGNED type. Use default Log >2012-08-06 12:37:31,763 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) [17b0a56e] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-08-06 12:37:31,779 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-74) [840bf70] SpmStopVDSCommand::Stopping SPM on vds purple-vds3, pool id efe20197-e0a7-49b8-beb4-19b1ed3f8c3f >2012-08-06 12:37:31,787 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-48) [35da10f2] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 12:37:31,800 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-48) [511c069e] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 12:37:31,823 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-74) [840bf70] FINISH, SpmStopVDSCommand, log id: 3372d620 >2012-08-06 12:37:31,824 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [840bf70] spm stop succeeded, continuing with spm selection >2012-08-06 12:37:31,852 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [840bf70] starting spm on vds purple-vds2, storage pool nfs31, prevId 2, LVER 1 >2012-08-06 12:37:31,857 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [840bf70] START, SpmStartVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, prevId=2, prevLVER=1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=true), log id: dd2514 >2012-08-06 12:37:31,886 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [840bf70] spmStart polling started: taskId = 27b135a8-a76a-4784-93d7-2edc2e36ea05 >2012-08-06 12:37:32,910 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [840bf70] spmStart polling ended: taskId = 27b135a8-a76a-4784-93d7-2edc2e36ea05 task status = finished >2012-08-06 12:37:32,933 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [840bf70] spmStart polling ended. spm status: SPM >2012-08-06 12:37:32,936 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-74) [840bf70] START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=27b135a8-a76a-4784-93d7-2edc2e36ea05), log id: 555eb31b >2012-08-06 12:37:32,960 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-74) [840bf70] FINISH, HSMClearTaskVDSCommand, log id: 555eb31b >2012-08-06 12:37:32,961 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [840bf70] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3c40dd66, log id: dd2514 >2012-08-06 12:37:32,988 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [840bf70] Initialize Irs proxy from vds: purple-vds2 >2012-08-06 12:37:33,043 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-72) Attempting to get and stop tasks on storage pool nfs31 >2012-08-06 12:37:33,043 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-72) START, SPMGetAllTasksInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6964581a >2012-08-06 12:37:33,261 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-72) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool efe20197-e0a7-49b8-beb4-19b1ed3f8c3f >2012-08-06 12:37:33,264 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-72) START, HSMGetAllTasksInfoVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7), log id: 5fb4145b >2012-08-06 12:37:33,287 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-72) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 5fb4145b >2012-08-06 12:37:33,288 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-72) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 6964581a >2012-08-06 12:37:33,288 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-72) Discovered no tasks on Storage Pool nfs31 >2012-08-06 12:37:33,289 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-72) START, SPMGetAllTasksInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 27a49373 >2012-08-06 12:37:33,294 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-72) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool efe20197-e0a7-49b8-beb4-19b1ed3f8c3f >2012-08-06 12:37:33,299 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-72) START, HSMGetAllTasksInfoVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7), log id: 18673a2b >2012-08-06 12:37:33,322 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-72) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 18673a2b >2012-08-06 12:37:33,323 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-72) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 27a49373 >2012-08-06 12:37:33,324 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-72) Discovered no tasks on Storage Pool nfs31 >2012-08-06 12:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable hosts >2012-08-06 12:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Autorecovering 0 hosts >2012-08-06 12:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable hosts done >2012-08-06 12:40:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable storage domains >2012-08-06 12:40:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Autorecovering 0 storage domains >2012-08-06 12:40:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable storage domains done >2012-08-06 12:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable hosts >2012-08-06 12:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Autorecovering 0 hosts >2012-08-06 12:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable hosts done >2012-08-06 12:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable storage domains >2012-08-06 12:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Autorecovering 0 storage domains >2012-08-06 12:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable storage domains done >2012-08-06 12:46:45,750 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) Start time: 8/6/12 12:46 PM >2012-08-06 12:46:45,900 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: CbcCheckOnVdsChange >2012-08-06 12:46:45,925 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: CAEngineKey >2012-08-06 12:46:45,926 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: ENGINEEARLib >2012-08-06 12:46:45,951 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: MinimalETLVersion >2012-08-06 12:46:46,271 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: ScriptsPath >2012-08-06 12:46:46,272 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: SQLServerI18NPrefix >2012-08-06 12:46:46,406 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (MSC service thread 1-1) Failed to decrypt Data must start with zero >2012-08-06 12:46:46,407 ERROR [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (MSC service thread 1-1) Failed to decrypt value for property TruststorePass will be used encrypted value >2012-08-06 12:46:46,498 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) VDSBrokerFrontend: 8/6/12 12:46 PM >2012-08-06 12:46:46,509 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) CpuFlagsManager: 8/6/12 12:46 PM >2012-08-06 12:46:46,510 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-1) Setting audit clean up manager to run at: 35 35 3 * * ? >2012-08-06 12:46:46,549 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) AuditLogCleanupManager: 8/6/12 12:46 PM >2012-08-06 12:46:46,559 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-1) TagsDirector initialization >2012-08-06 12:46:46,596 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-1) Tag root added to tree >2012-08-06 12:46:46,620 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) TagsDirector: 8/6/12 12:46 PM >2012-08-06 12:46:46,642 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) IsoDomainListSyncronizer: 8/6/12 12:46 PM >2012-08-06 12:46:46,685 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) InitHandlers: 8/6/12 12:46 PM >2012-08-06 12:46:46,710 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-1) Code VDS_FENCING_OPERATION_FAILED appears more then once in string table. >2012-08-06 12:46:46,712 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) ErrorTranslator: 8/6/12 12:46 PM >2012-08-06 12:46:46,713 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) VdsErrorTranslator: 8/6/12 12:46 PM >2012-08-06 12:46:46,714 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) Mark uncompleted jobs as UNKNOWN: 8/6/12 12:46 PM >2012-08-06 12:46:46,816 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) JobRepositoryCleanupManager: 8/6/12 12:46 PM >2012-08-06 12:46:46,820 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) AutoRecoveryManager: 8/6/12 12:46 PM >2012-08-06 12:46:46,824 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) ExecutionMessageDirector: 8/6/12 12:46 PM >2012-08-06 12:46:46,861 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (MSC service thread 1-1) UsersDomainsCacheManager: 8/6/12 12:46 PM >2012-08-06 12:46:46,864 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-2) InitResourceManager: 8/6/12 12:46 PM >2012-08-06 12:46:46,871 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-2) ResourceManager::ResourceManager::Entered >2012-08-06 12:46:46,960 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (MSC service thread 1-1) DbUserCacheManager: 8/6/12 12:46 PM >2012-08-06 12:46:47,019 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-1) DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 12:46:52,204 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-2) Eneterd VdsManager:constructor >2012-08-06 12:46:52,209 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-2) vdsBroker(purple-vds2,54,321) >2012-08-06 12:46:52,418 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-2) ResourceManager::AddVds - VDS 4196a566-dee6-11e1-b66e-c35c5273fee7 was added to the Resource Manager >2012-08-06 12:46:55,377 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: UNASSIGNED not exist in string table >2012-08-06 12:46:55,378 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table >2012-08-06 12:46:55,384 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: DWH_STOPPED not exist in string table >2012-08-06 12:46:55,385 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: DWH_STARTED not exist in string table >2012-08-06 12:46:55,385 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: DWH_ERROR not exist in string table >2012-08-06 12:46:55,391 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2012-08-06 12:46:55,397 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_FAILED_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2012-08-06 12:46:55,398 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2012-08-06 12:46:55,398 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_FAILED_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2012-08-06 12:46:57,423 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-2) Eneterd VdsManager:constructor >2012-08-06 12:46:57,426 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-2) vdsBroker(purple-vds3,54,321) >2012-08-06 12:46:57,433 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-2) ResourceManager::AddVds - VDS 47028088-dee6-11e1-bffa-2f8f15de3134 was added to the Resource Manager >2012-08-06 12:46:57,518 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (MSC service thread 1-2) AsyncTaskManager: Initialization of AsyncTaskManager completed successfully. >2012-08-06 12:46:57,523 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-2) AsyncTaskManager: 8/6/12 12:46 PM >2012-08-06 12:46:57,526 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-2) VdsLoadBalancer: 8/6/12 12:46 PM >2012-08-06 12:46:57,536 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (pool-3-thread-4) MacPoolManager started: 8/6/12 12:46 PM >2012-08-06 12:46:57,691 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-2) Initializing Host: purple-vds2 >2012-08-06 12:46:57,855 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (pool-3-thread-4) MacPoolManager finished: 8/6/12 12:46 PM >2012-08-06 12:46:57,981 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-2) [4bf8f9e2] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 12:47:00,271 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-3) Initializing Host: purple-vds3 >2012-08-06 12:47:00,327 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-3) [9b6df20] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 12:47:07,630 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-16) [52ab9d99] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-06 12:47:07,832 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [52ab9d99] hostFromVds::selectedVds - purple-vds2, spmStatus SPM, storage pool nfs31 >2012-08-06 12:47:07,855 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [52ab9d99] Initialize Irs proxy from vds: purple-vds2 >2012-08-06 12:47:08,220 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) START, SPMGetAllTasksInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 3bbd249b >2012-08-06 12:47:08,446 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool efe20197-e0a7-49b8-beb4-19b1ed3f8c3f >2012-08-06 12:47:08,482 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) START, HSMGetAllTasksInfoVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7), log id: 4247cb74 >2012-08-06 12:47:08,574 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 4247cb74 >2012-08-06 12:47:08,575 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 3bbd249b >2012-08-06 12:47:08,576 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-18) Discovered no tasks on Storage Pool nfs31 >2012-08-06 12:47:43,632 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-2) Checking if user admin@internal is an admin, result true >2012-08-06 12:47:43,636 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-2) Running command: LoginAdminUserCommand internal: false. >2012-08-06 12:47:45,248 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-9) Adding new value to configuration cache. >2012-08-06 12:47:45,249 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-9) Didnt find the value of DBPagingType in DB for version general - using default: Offset >2012-08-06 12:47:45,251 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-9) Adding new value to configuration cache. >2012-08-06 12:47:45,251 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-9) Didnt find the value of DBPagingSyntax in DB for version general - using default: OFFSET (%1$s -1) LIMIT %2$s >2012-08-06 12:47:45,252 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-9) Adding new value to configuration cache. >2012-08-06 12:47:45,261 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-9) Didnt find the value of DBSearchTemplate in DB for version general - using default: SELECT * FROM (%2$s) %1$s) as T1 %3$s >2012-08-06 12:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Checking autorecoverable hosts >2012-08-06 12:50:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Autorecovering 0 hosts >2012-08-06 12:50:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Checking autorecoverable hosts done >2012-08-06 12:50:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Checking autorecoverable storage domains >2012-08-06 12:50:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Autorecovering 0 storage domains >2012-08-06 12:50:00,025 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Checking autorecoverable storage domains done >2012-08-06 12:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Checking autorecoverable hosts >2012-08-06 12:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Autorecovering 0 hosts >2012-08-06 12:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Checking autorecoverable hosts done >2012-08-06 12:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Checking autorecoverable storage domains >2012-08-06 12:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Autorecovering 0 storage domains >2012-08-06 12:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Checking autorecoverable storage domains done >2012-08-06 13:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts >2012-08-06 13:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering 0 hosts >2012-08-06 13:00:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts done >2012-08-06 13:00:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable storage domains >2012-08-06 13:00:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering 0 storage domains >2012-08-06 13:00:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable storage domains done >2012-08-06 13:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Checking autorecoverable hosts >2012-08-06 13:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Autorecovering 0 hosts >2012-08-06 13:05:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Checking autorecoverable hosts done >2012-08-06 13:05:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Checking autorecoverable storage domains >2012-08-06 13:05:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Autorecovering 0 storage domains >2012-08-06 13:05:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Checking autorecoverable storage domains done >2012-08-06 13:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable hosts >2012-08-06 13:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Autorecovering 0 hosts >2012-08-06 13:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable hosts done >2012-08-06 13:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable storage domains >2012-08-06 13:10:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Autorecovering 0 storage domains >2012-08-06 13:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable storage domains done >2012-08-06 13:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Checking autorecoverable hosts >2012-08-06 13:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Autorecovering 0 hosts >2012-08-06 13:15:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Checking autorecoverable hosts done >2012-08-06 13:15:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Checking autorecoverable storage domains >2012-08-06 13:15:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Autorecovering 0 storage domains >2012-08-06 13:15:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) Checking autorecoverable storage domains done >2012-08-06 13:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Checking autorecoverable hosts >2012-08-06 13:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Autorecovering 0 hosts >2012-08-06 13:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Checking autorecoverable hosts done >2012-08-06 13:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Checking autorecoverable storage domains >2012-08-06 13:20:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Autorecovering 0 storage domains >2012-08-06 13:20:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Checking autorecoverable storage domains done >2012-08-06 13:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable hosts >2012-08-06 13:25:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Autorecovering 0 hosts >2012-08-06 13:25:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable hosts done >2012-08-06 13:25:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable storage domains >2012-08-06 13:25:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Autorecovering 0 storage domains >2012-08-06 13:25:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable storage domains done >2012-08-06 13:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Checking autorecoverable hosts >2012-08-06 13:30:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Autorecovering 0 hosts >2012-08-06 13:30:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Checking autorecoverable hosts done >2012-08-06 13:30:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Checking autorecoverable storage domains >2012-08-06 13:30:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Autorecovering 0 storage domains >2012-08-06 13:30:00,021 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Checking autorecoverable storage domains done >2012-08-06 13:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable hosts >2012-08-06 13:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Autorecovering 0 hosts >2012-08-06 13:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable hosts done >2012-08-06 13:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable storage domains >2012-08-06 13:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Autorecovering 0 storage domains >2012-08-06 13:35:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Checking autorecoverable storage domains done >2012-08-06 13:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [52ab9d99] Checking autorecoverable hosts >2012-08-06 13:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [52ab9d99] Autorecovering 0 hosts >2012-08-06 13:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [52ab9d99] Checking autorecoverable hosts done >2012-08-06 13:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [52ab9d99] Checking autorecoverable storage domains >2012-08-06 13:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [52ab9d99] Autorecovering 0 storage domains >2012-08-06 13:40:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [52ab9d99] Checking autorecoverable storage domains done >2012-08-06 13:44:28,475 INFO [org.ovirt.engine.core.bll.MaintananceNumberOfVdssCommand] (pool-3-thread-48) [55e7fef9] Running command: MaintananceNumberOfVdssCommand internal: false. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 13:44:28,483 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-48) [55e7fef9] START, SetVdsStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, status=PreparingForMaintenance, nonOperationalReason=NONE), log id: 7c50838a >2012-08-06 13:44:28,602 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-48) [55e7fef9] SetVdsStatusVDSCommand::VSD purple-vds2 is spm and moved from up calling ResetIrs. >2012-08-06 13:44:28,605 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (pool-3-thread-48) [55e7fef9] START, ResetIrsVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, hostName = purple-vds2, vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, ignoreStopFailed = false), log id: 62153bf1 >2012-08-06 13:44:28,615 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-3-thread-48) [55e7fef9] START, SpmStopVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f), log id: 1a0e1009 >2012-08-06 13:44:28,648 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-3-thread-48) [55e7fef9] SpmStopVDSCommand::Stopping SPM on vds purple-vds2, pool id efe20197-e0a7-49b8-beb4-19b1ed3f8c3f >2012-08-06 13:44:29,171 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-3-thread-48) [55e7fef9] FINISH, SpmStopVDSCommand, log id: 1a0e1009 >2012-08-06 13:44:29,191 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (pool-3-thread-48) [55e7fef9] FINISH, ResetIrsVDSCommand, log id: 62153bf1 >2012-08-06 13:44:29,195 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-48) [55e7fef9] FINISH, SetVdsStatusVDSCommand, log id: 7c50838a >2012-08-06 13:44:29,259 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-78) vds::Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 4196a566-dee6-11e1-b66e-c35c5273fee7 : purple-vds2 >2012-08-06 13:44:29,336 INFO [org.ovirt.engine.core.bll.MaintananceVdsCommand] (pool-3-thread-48) [7f97e6fe] Running command: MaintananceVdsCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 13:44:29,363 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-78) Clearing cache of pool: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f for problematic entities of VDS: purple-vds2. >2012-08-06 13:44:29,372 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (QuartzScheduler_Worker-78) START, DisconnectStoragePoolVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, vds_spm_id = 1, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 0), log id: 28381c95 >2012-08-06 13:44:29,442 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (pool-3-thread-48) [7f97e6fe] Adding new value to configuration cache. >2012-08-06 13:44:29,443 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (pool-3-thread-48) [7f97e6fe] Didnt find the value of DBI18NPrefix in DB for version general - using default: >2012-08-06 13:44:31,401 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (QuartzScheduler_Worker-78) FINISH, DisconnectStoragePoolVDSCommand, log id: 28381c95 >2012-08-06 13:44:31,407 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (QuartzScheduler_Worker-78) [1be8623a] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-06 13:44:31,447 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (QuartzScheduler_Worker-78) [1be8623a] START, DisconnectStorageServerVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, storageType = NFS, connectionList = [{ id: f6121783-5d14-493d-a12e-9b31402f985b, connection: orion.qa.lab.tlv.redhat.com:/export/lesik };]), log id: 767521f3 >2012-08-06 13:44:33,623 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (QuartzScheduler_Worker-78) [1be8623a] FINISH, DisconnectStorageServerVDSCommand, return: {f6121783-5d14-493d-a12e-9b31402f985b=0}, log id: 767521f3 >2012-08-06 13:44:34,342 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-97) [a121627] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-06 13:44:34,465 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) [a121627] hostFromVds::selectedVds - purple-vds3, spmStatus Free, storage pool nfs31 >2012-08-06 13:44:34,495 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) [a121627] SPM Init: could not find reported vds or not up - pool:nfs31 vds_spm_id: 1 >2012-08-06 13:44:34,508 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) [a121627] SPM selection - vds seems as spm purple-vds2 >2012-08-06 13:44:34,510 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-97) [a121627] START, SpmStopVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f), log id: 614e4ce2 >2012-08-06 13:44:34,540 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-97) [a121627] SpmStopVDSCommand::Stopping SPM on vds purple-vds2, pool id efe20197-e0a7-49b8-beb4-19b1ed3f8c3f >2012-08-06 13:44:34,567 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-97) [a121627] FINISH, SpmStopVDSCommand, log id: 614e4ce2 >2012-08-06 13:44:34,568 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) [a121627] spm stop succeeded, continuing with spm selection >2012-08-06 13:44:34,815 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) [a121627] starting spm on vds purple-vds3, storage pool nfs31, prevId 1, LVER 2 >2012-08-06 13:44:34,823 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) [a121627] START, SpmStartVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, prevId=1, prevLVER=2, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=true), log id: e694a01 >2012-08-06 13:44:34,860 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) [a121627] spmStart polling started: taskId = 0ac9a0e6-b0e9-4fc8-8c06-b3aa8eaa802c >2012-08-06 13:44:35,886 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) [a121627] spmStart polling ended: taskId = 0ac9a0e6-b0e9-4fc8-8c06-b3aa8eaa802c task status = finished >2012-08-06 13:44:35,906 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) [a121627] spmStart polling ended. spm status: SPM >2012-08-06 13:44:35,908 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-97) [a121627] START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=0ac9a0e6-b0e9-4fc8-8c06-b3aa8eaa802c), log id: 3cc3e5f >2012-08-06 13:44:35,929 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-97) [a121627] FINISH, HSMClearTaskVDSCommand, log id: 3cc3e5f >2012-08-06 13:44:35,929 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) [a121627] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2ad05470, log id: e694a01 >2012-08-06 13:44:35,950 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) [a121627] Initialize Irs proxy from vds: purple-vds3 >2012-08-06 13:44:35,998 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-93) Attempting to get and stop tasks on storage pool nfs31 >2012-08-06 13:44:35,999 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-93) START, SPMGetAllTasksInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 60bdcf2b >2012-08-06 13:44:36,085 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-93) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool efe20197-e0a7-49b8-beb4-19b1ed3f8c3f >2012-08-06 13:44:36,087 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-93) START, HSMGetAllTasksInfoVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134), log id: d4753b8 >2012-08-06 13:44:36,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-93) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: d4753b8 >2012-08-06 13:44:36,109 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-93) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 60bdcf2b >2012-08-06 13:44:36,109 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-93) Discovered no tasks on Storage Pool nfs31 >2012-08-06 13:44:36,114 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-93) START, SPMGetAllTasksInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 37d69ec7 >2012-08-06 13:44:36,115 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-93) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool efe20197-e0a7-49b8-beb4-19b1ed3f8c3f >2012-08-06 13:44:36,119 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-93) START, HSMGetAllTasksInfoVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134), log id: 2af69b63 >2012-08-06 13:44:36,139 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-93) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 2af69b63 >2012-08-06 13:44:36,140 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-93) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 37d69ec7 >2012-08-06 13:44:36,140 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-93) Discovered no tasks on Storage Pool nfs31 >2012-08-06 13:44:44,695 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8009-4) Lock Acquired to object EngineLock [exclusiveLocks= key: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 value: VM >, sharedLocks= ] >2012-08-06 13:44:44,763 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-4) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 12b68f85 >2012-08-06 13:44:44,765 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-4) FINISH, IsValidVDSCommand, return: true, log id: 12b68f85 >2012-08-06 13:44:44,873 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-4) START, IsVmDuringInitiatingVDSCommand(vmId = 54b872c6-cefc-4a19-b48e-9bc1a09285f9), log id: 1643ed16 >2012-08-06 13:44:44,874 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-4) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 1643ed16 >2012-08-06 13:44:44,988 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) [ec34c1] Running command: RunVmCommand internal: false. Entities affected : ID: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 Type: VM >2012-08-06 13:44:45,032 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-50) [ec34c1] START, CreateVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=54b872c6-cefc-4a19-b48e-9bc1a09285f9, vm=org.ovirt.engine.core.common.businessentities.VM@cd69f92), log id: a944753 >2012-08-06 13:44:45,060 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-50) [ec34c1] START, CreateVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=54b872c6-cefc-4a19-b48e-9bc1a09285f9, vm=org.ovirt.engine.core.common.businessentities.VM@cd69f92), log id: 373d4793 >2012-08-06 13:44:45,229 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-50) [ec34c1] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=0,transparentHugePages=true,vmId=54b872c6-cefc-4a19-b48e-9bc1a09285f9,devices=[Ljava.util.Map;@88ce01a,acpiEnable=true,vmName=lesik,cpuType=Conroe,custom={} >2012-08-06 13:44:45,230 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-50) [ec34c1] FINISH, CreateVDSCommand, log id: 373d4793 >2012-08-06 13:44:45,243 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-50) [ec34c1] IncreasePendingVms::CreateVmIncreasing vds purple-vds3 pending vcpu count, now 1. Vm: lesik >2012-08-06 13:44:45,279 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-50) [ec34c1] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: a944753 >2012-08-06 13:44:45,280 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) [ec34c1] Lock freed to object EngineLock [exclusiveLocks= key: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 value: VM >, sharedLocks= ] >2012-08-06 13:44:48,083 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-21) VM lesik 54b872c6-cefc-4a19-b48e-9bc1a09285f9 moved from WaitForLaunch --> PoweringUp >2012-08-06 13:44:48,112 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-21) START, FullListVdsCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=null, vmIds=[54b872c6-cefc-4a19-b48e-9bc1a09285f9]), log id: 3e575417 >2012-08-06 13:44:48,141 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-21) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@5751d1fa, log id: 3e575417 >2012-08-06 13:44:49,247 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [50f292ac] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 Type: VM >2012-08-06 13:44:49,251 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [50f292ac] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop lesik). >2012-08-06 13:44:49,252 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [50f292ac] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop lesik, status is not up. Stopping instead. >2012-08-06 13:44:49,267 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-50) [52185e1c] Running command: StopVmCommand internal: true. Entities affected : ID: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 Type: VM >2012-08-06 13:44:49,275 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [52185e1c] START, DestroyVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=54b872c6-cefc-4a19-b48e-9bc1a09285f9, force=false, secondsToWait=0, gracefully=false), log id: 52456195 >2012-08-06 13:44:49,302 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [52185e1c] START, DestroyVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=54b872c6-cefc-4a19-b48e-9bc1a09285f9, force=false, secondsToWait=0, gracefully=false), log id: 31f5ab7 >2012-08-06 13:44:49,796 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [52185e1c] FINISH, DestroyVDSCommand, log id: 31f5ab7 >2012-08-06 13:44:49,832 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [52185e1c] FINISH, DestroyVmVDSCommand, return: Down, log id: 52456195 >2012-08-06 13:44:51,065 WARN [org.ovirt.engine.core.bll.ShutdownVmCommand] (ajp--127.0.0.1-8009-6) CanDoAction of action ShutdownVm failed. Reasons:ACTION_TYPE_FAILED_VM_IS_NOT_RUNNING,VAR__ACTION__SHUTDOWN,VAR__TYPE__VM >2012-08-06 13:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Checking autorecoverable hosts >2012-08-06 13:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Autorecovering 0 hosts >2012-08-06 13:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Checking autorecoverable hosts done >2012-08-06 13:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Checking autorecoverable storage domains >2012-08-06 13:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Autorecovering 0 storage domains >2012-08-06 13:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Checking autorecoverable storage domains done >2012-08-06 13:45:09,675 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-11) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1b8251d3 >2012-08-06 13:45:09,700 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-11) FINISH, IsValidVDSCommand, return: true, log id: 1b8251d3 >2012-08-06 13:45:09,717 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-11) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4019f9c2 >2012-08-06 13:45:09,724 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-11) FINISH, IsValidVDSCommand, return: true, log id: 4019f9c2 >2012-08-06 13:45:09,875 INFO [org.ovirt.engine.core.bll.AddVmPoolWithVmsCommand] (pool-3-thread-50) [5b4e0c87] Running command: AddVmPoolWithVmsCommand internal: false. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate >2012-08-06 13:45:10,112 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [6f8b1193] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 532967ac >2012-08-06 13:45:10,114 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [6f8b1193] FINISH, IsValidVDSCommand, return: true, log id: 532967ac >2012-08-06 13:45:10,162 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-50) [6f8b1193] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:10,183 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [60d6b174] Lock Acquired to object EngineLock [exclusiveLocks= key: pool1-1 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:10,205 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [60d6b174] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 3c537f12 >2012-08-06 13:45:10,208 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [60d6b174] FINISH, IsValidVDSCommand, return: true, log id: 3c537f12 >2012-08-06 13:45:10,216 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [60d6b174] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:10,218 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [60d6b174] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 59b4bf99 >2012-08-06 13:45:10,222 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [60d6b174] FINISH, IsValidVDSCommand, return: true, log id: 59b4bf99 >2012-08-06 13:45:10,256 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [60d6b174] MacPoolManager::allocateNewMac entered >2012-08-06 13:45:10,256 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [60d6b174] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:68 >2012-08-06 13:45:10,329 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [60d6b174] Lock freed to object EngineLock [exclusiveLocks= key: pool1-1 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:10,331 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [60d6b174] START, SetVmStatusVDSCommand(vmId = 3c7c0453-5f05-4314-bdd4-eb4fd243f80a, status = ImageLocked), log id: 6ec63335 >2012-08-06 13:45:10,346 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [60d6b174] FINISH, SetVmStatusVDSCommand, log id: 6ec63335 >2012-08-06 13:45:10,395 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-50) [5b17c0c3] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 13:45:10,415 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [5b17c0c3] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 231b5775 >2012-08-06 13:45:10,475 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [5b17c0c3] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a851d2e4, log id: 231b5775 >2012-08-06 13:45:10,484 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [5b17c0c3] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = d7801e81-b9b2-4985-acae-7d3ac3e5628e, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 67788645-ff3f-410e-8b5c-161545634ecd, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 9334713 >2012-08-06 13:45:10,486 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [5b17c0c3] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 13:45:10,487 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [5b17c0c3] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=d7801e81-b9b2-4985-acae-7d3ac3e5628e > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=67788645-ff3f-410e-8b5c-161545634ecd > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 13:45:11,427 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [5b17c0c3] FINISH, CreateSnapshotVDSCommand, return: 67788645-ff3f-410e-8b5c-161545634ecd, log id: 9334713 >2012-08-06 13:45:11,472 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) [5b17c0c3] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 3c7c0453-5f05-4314-bdd4-eb4fd243f80a >2012-08-06 13:45:11,473 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [5b17c0c3] EntityMultiAsyncTasks::AttachTask: Attaching task b6bea98f-a9ca-4b71-a6c3-19f80db33416 to entity 3c7c0453-5f05-4314-bdd4-eb4fd243f80a. >2012-08-06 13:45:11,495 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-50) [5b17c0c3] Adding task b6bea98f-a9ca-4b71-a6c3-19f80db33416 to DataBase >2012-08-06 13:45:11,729 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-50) [5b17c0c3] Adding task b6bea98f-a9ca-4b71-a6c3-19f80db33416 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 13:45:12,090 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) [5b17c0c3] BaseAsyncTask::StartPollingTask: Starting to poll task b6bea98f-a9ca-4b71-a6c3-19f80db33416. >2012-08-06 13:45:12,091 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [5b17c0c3] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 3c7c0453-5f05-4314-bdd4-eb4fd243f80a is AddVm (determined by task b6bea98f-a9ca-4b71-a6c3-19f80db33416) >2012-08-06 13:45:12,126 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-50) [207ea58b] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: cb2eea72-dfb3-11e1-89f8-5b30530ef35f Type: VmPool >2012-08-06 13:45:12,220 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [473aedb6] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 28169a38 >2012-08-06 13:45:12,221 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [473aedb6] FINISH, IsValidVDSCommand, return: true, log id: 28169a38 >2012-08-06 13:45:12,266 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-50) [473aedb6] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:12,277 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [6d9a5ab8] Lock Acquired to object EngineLock [exclusiveLocks= key: pool1-2 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:12,295 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [6d9a5ab8] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 2c8ee336 >2012-08-06 13:45:12,296 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [6d9a5ab8] FINISH, IsValidVDSCommand, return: true, log id: 2c8ee336 >2012-08-06 13:45:12,298 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [6d9a5ab8] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:12,300 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [6d9a5ab8] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 397988b8 >2012-08-06 13:45:12,301 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [6d9a5ab8] FINISH, IsValidVDSCommand, return: true, log id: 397988b8 >2012-08-06 13:45:12,308 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [6d9a5ab8] MacPoolManager::allocateNewMac entered >2012-08-06 13:45:12,308 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [6d9a5ab8] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:67 >2012-08-06 13:45:12,353 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [6d9a5ab8] Lock freed to object EngineLock [exclusiveLocks= key: pool1-2 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:12,354 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [6d9a5ab8] START, SetVmStatusVDSCommand(vmId = 6df57989-99a7-4ec9-8f7c-15f222064e61, status = ImageLocked), log id: 663ad589 >2012-08-06 13:45:12,357 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [6d9a5ab8] FINISH, SetVmStatusVDSCommand, log id: 663ad589 >2012-08-06 13:45:12,360 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-50) [2ce87751] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 13:45:12,362 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [2ce87751] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 13057322 >2012-08-06 13:45:12,407 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [2ce87751] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a851d2e4, log id: 13057322 >2012-08-06 13:45:12,410 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [2ce87751] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 12a98932-3b70-4d2f-a157-f42a515563cd, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 16885496-8295-4953-b4cc-cbcb146ddcc0, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 1f051586 >2012-08-06 13:45:12,412 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [2ce87751] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 13:45:12,412 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [2ce87751] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=12a98932-3b70-4d2f-a157-f42a515563cd > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=16885496-8295-4953-b4cc-cbcb146ddcc0 > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 13:45:12,858 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [2ce87751] FINISH, CreateSnapshotVDSCommand, return: 16885496-8295-4953-b4cc-cbcb146ddcc0, log id: 1f051586 >2012-08-06 13:45:12,894 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) [2ce87751] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 6df57989-99a7-4ec9-8f7c-15f222064e61 >2012-08-06 13:45:12,894 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [2ce87751] EntityMultiAsyncTasks::AttachTask: Attaching task 0ca054cd-4d9d-4290-9511-e6b8db6a6cc6 to entity 6df57989-99a7-4ec9-8f7c-15f222064e61. >2012-08-06 13:45:12,896 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-50) [2ce87751] Adding task 0ca054cd-4d9d-4290-9511-e6b8db6a6cc6 to DataBase >2012-08-06 13:45:13,109 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-50) [2ce87751] Adding task 0ca054cd-4d9d-4290-9511-e6b8db6a6cc6 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 13:45:13,387 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) [2ce87751] BaseAsyncTask::StartPollingTask: Starting to poll task 0ca054cd-4d9d-4290-9511-e6b8db6a6cc6. >2012-08-06 13:45:13,388 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [2ce87751] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 6df57989-99a7-4ec9-8f7c-15f222064e61 is AddVm (determined by task 0ca054cd-4d9d-4290-9511-e6b8db6a6cc6) >2012-08-06 13:45:13,405 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-50) [70983b23] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: cb2eea72-dfb3-11e1-89f8-5b30530ef35f Type: VmPool >2012-08-06 13:45:13,511 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [298ec402] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 3e17e58a >2012-08-06 13:45:13,514 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [298ec402] FINISH, IsValidVDSCommand, return: true, log id: 3e17e58a >2012-08-06 13:45:13,564 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-50) [298ec402] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:13,584 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [38d94a62] Lock Acquired to object EngineLock [exclusiveLocks= key: pool1-3 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:13,659 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [38d94a62] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 5f2fc7f9 >2012-08-06 13:45:13,660 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [38d94a62] FINISH, IsValidVDSCommand, return: true, log id: 5f2fc7f9 >2012-08-06 13:45:13,662 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [38d94a62] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:13,669 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [38d94a62] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6001ac15 >2012-08-06 13:45:13,674 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [38d94a62] FINISH, IsValidVDSCommand, return: true, log id: 6001ac15 >2012-08-06 13:45:13,685 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [38d94a62] MacPoolManager::allocateNewMac entered >2012-08-06 13:45:13,685 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [38d94a62] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:66 >2012-08-06 13:45:13,721 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [38d94a62] Lock freed to object EngineLock [exclusiveLocks= key: pool1-3 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:13,722 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [38d94a62] START, SetVmStatusVDSCommand(vmId = d3c805a2-419c-480f-8627-f5c9ef5c4117, status = ImageLocked), log id: 5203e000 >2012-08-06 13:45:13,730 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [38d94a62] FINISH, SetVmStatusVDSCommand, log id: 5203e000 >2012-08-06 13:45:13,734 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-50) [3ae19f28] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 13:45:13,736 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [3ae19f28] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 102b40e >2012-08-06 13:45:13,792 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [3ae19f28] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a851d2e4, log id: 102b40e >2012-08-06 13:45:13,796 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [3ae19f28] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 716ed6d4-2262-46f4-bf30-bf748cb033f4, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 45ebe6b2-2d34-4150-9ec5-0f84e96f5c0e, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 3279db7c >2012-08-06 13:45:13,797 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [3ae19f28] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 13:45:13,803 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [3ae19f28] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=716ed6d4-2262-46f4-bf30-bf748cb033f4 > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=45ebe6b2-2d34-4150-9ec5-0f84e96f5c0e > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 13:45:14,151 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [3ae19f28] FINISH, CreateSnapshotVDSCommand, return: 45ebe6b2-2d34-4150-9ec5-0f84e96f5c0e, log id: 3279db7c >2012-08-06 13:45:14,170 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) [3ae19f28] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity d3c805a2-419c-480f-8627-f5c9ef5c4117 >2012-08-06 13:45:14,171 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [3ae19f28] EntityMultiAsyncTasks::AttachTask: Attaching task f47de081-04b1-4400-80eb-e5e4e5b2c597 to entity d3c805a2-419c-480f-8627-f5c9ef5c4117. >2012-08-06 13:45:14,172 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-50) [3ae19f28] Adding task f47de081-04b1-4400-80eb-e5e4e5b2c597 to DataBase >2012-08-06 13:45:14,259 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-50) [3ae19f28] Adding task f47de081-04b1-4400-80eb-e5e4e5b2c597 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 13:45:14,453 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) [3ae19f28] BaseAsyncTask::StartPollingTask: Starting to poll task f47de081-04b1-4400-80eb-e5e4e5b2c597. >2012-08-06 13:45:14,453 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [3ae19f28] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity d3c805a2-419c-480f-8627-f5c9ef5c4117 is AddVm (determined by task f47de081-04b1-4400-80eb-e5e4e5b2c597) >2012-08-06 13:45:14,465 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-50) [43c17da6] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: cb2eea72-dfb3-11e1-89f8-5b30530ef35f Type: VmPool >2012-08-06 13:45:14,563 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [549f576a] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4a1567ab >2012-08-06 13:45:14,564 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [549f576a] FINISH, IsValidVDSCommand, return: true, log id: 4a1567ab >2012-08-06 13:45:15,022 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-50) [549f576a] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:15,038 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [6256ac86] Lock Acquired to object EngineLock [exclusiveLocks= key: pool1-4 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:15,076 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [6256ac86] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 2c90036d >2012-08-06 13:45:15,078 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [6256ac86] FINISH, IsValidVDSCommand, return: true, log id: 2c90036d >2012-08-06 13:45:15,079 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [6256ac86] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:15,084 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [6256ac86] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4a0338a >2012-08-06 13:45:15,085 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [6256ac86] FINISH, IsValidVDSCommand, return: true, log id: 4a0338a >2012-08-06 13:45:15,096 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [6256ac86] MacPoolManager::allocateNewMac entered >2012-08-06 13:45:15,097 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [6256ac86] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:65 >2012-08-06 13:45:15,123 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [6256ac86] Lock freed to object EngineLock [exclusiveLocks= key: pool1-4 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:15,124 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [6256ac86] START, SetVmStatusVDSCommand(vmId = a7d2a056-b67b-4bc5-b8ea-7afef2d2b861, status = ImageLocked), log id: 78b0c01a >2012-08-06 13:45:15,129 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [6256ac86] FINISH, SetVmStatusVDSCommand, log id: 78b0c01a >2012-08-06 13:45:15,130 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-50) [6743a7c2] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 13:45:15,132 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [6743a7c2] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 7fc8cf6e >2012-08-06 13:45:15,196 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [6743a7c2] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a851d2e4, log id: 7fc8cf6e >2012-08-06 13:45:15,199 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [6743a7c2] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 558dbca6-df11-44af-86a7-07b8bb79e7ea, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 28dc1eca-24ba-4173-adbf-c758b649892e, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 5ba6fefb >2012-08-06 13:45:15,201 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [6743a7c2] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 13:45:15,202 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [6743a7c2] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=558dbca6-df11-44af-86a7-07b8bb79e7ea > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=28dc1eca-24ba-4173-adbf-c758b649892e > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 13:45:15,318 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [6743a7c2] FINISH, CreateSnapshotVDSCommand, return: 28dc1eca-24ba-4173-adbf-c758b649892e, log id: 5ba6fefb >2012-08-06 13:45:15,339 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) [6743a7c2] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 >2012-08-06 13:45:15,340 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [6743a7c2] EntityMultiAsyncTasks::AttachTask: Attaching task 6421910a-d65f-4365-a942-79329ebc2541 to entity a7d2a056-b67b-4bc5-b8ea-7afef2d2b861. >2012-08-06 13:45:15,342 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-50) [6743a7c2] Adding task 6421910a-d65f-4365-a942-79329ebc2541 to DataBase >2012-08-06 13:45:15,477 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-50) [6743a7c2] Adding task 6421910a-d65f-4365-a942-79329ebc2541 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 13:45:15,788 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) [6743a7c2] BaseAsyncTask::StartPollingTask: Starting to poll task 6421910a-d65f-4365-a942-79329ebc2541. >2012-08-06 13:45:15,789 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [6743a7c2] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 is AddVm (determined by task 6421910a-d65f-4365-a942-79329ebc2541) >2012-08-06 13:45:15,799 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-50) [7caed863] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: cb2eea72-dfb3-11e1-89f8-5b30530ef35f Type: VmPool >2012-08-06 13:45:15,883 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [649b392b] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 22fd1ed7 >2012-08-06 13:45:15,885 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [649b392b] FINISH, IsValidVDSCommand, return: true, log id: 22fd1ed7 >2012-08-06 13:45:15,935 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-50) [649b392b] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:15,952 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [72dcaaca] Lock Acquired to object EngineLock [exclusiveLocks= key: pool1-5 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:15,978 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [72dcaaca] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 5a4d5edc >2012-08-06 13:45:15,979 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [72dcaaca] FINISH, IsValidVDSCommand, return: true, log id: 5a4d5edc >2012-08-06 13:45:15,981 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [72dcaaca] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:15,982 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [72dcaaca] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 73cc81e3 >2012-08-06 13:45:15,984 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [72dcaaca] FINISH, IsValidVDSCommand, return: true, log id: 73cc81e3 >2012-08-06 13:45:15,997 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [72dcaaca] MacPoolManager::allocateNewMac entered >2012-08-06 13:45:15,997 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [72dcaaca] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:64 >2012-08-06 13:45:16,042 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [72dcaaca] Lock freed to object EngineLock [exclusiveLocks= key: pool1-5 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:16,043 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [72dcaaca] START, SetVmStatusVDSCommand(vmId = c1cb365c-a119-493c-964c-faf65a10c889, status = ImageLocked), log id: 225528c6 >2012-08-06 13:45:16,048 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [72dcaaca] FINISH, SetVmStatusVDSCommand, log id: 225528c6 >2012-08-06 13:45:16,050 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-50) [54359687] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 13:45:16,053 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [54359687] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 2963c887 >2012-08-06 13:45:16,151 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [54359687] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a851d2e4, log id: 2963c887 >2012-08-06 13:45:16,154 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [54359687] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 94269f14-e5b7-4fa9-90ea-7eda93dee529, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = cb6c00f6-d37e-4a23-9992-2ad1f8716b6f, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 69e9cf6c >2012-08-06 13:45:16,156 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [54359687] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 13:45:16,157 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [54359687] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=94269f14-e5b7-4fa9-90ea-7eda93dee529 > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=cb6c00f6-d37e-4a23-9992-2ad1f8716b6f > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 13:45:16,280 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [54359687] FINISH, CreateSnapshotVDSCommand, return: cb6c00f6-d37e-4a23-9992-2ad1f8716b6f, log id: 69e9cf6c >2012-08-06 13:45:16,303 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) [54359687] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity c1cb365c-a119-493c-964c-faf65a10c889 >2012-08-06 13:45:16,304 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [54359687] EntityMultiAsyncTasks::AttachTask: Attaching task 021febf0-cb7e-4563-8d48-8e70bbad98d1 to entity c1cb365c-a119-493c-964c-faf65a10c889. >2012-08-06 13:45:16,306 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-50) [54359687] Adding task 021febf0-cb7e-4563-8d48-8e70bbad98d1 to DataBase >2012-08-06 13:45:16,377 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-50) [54359687] Adding task 021febf0-cb7e-4563-8d48-8e70bbad98d1 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 13:45:16,731 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) [54359687] BaseAsyncTask::StartPollingTask: Starting to poll task 021febf0-cb7e-4563-8d48-8e70bbad98d1. >2012-08-06 13:45:16,733 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [54359687] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity c1cb365c-a119-493c-964c-faf65a10c889 is AddVm (determined by task 021febf0-cb7e-4563-8d48-8e70bbad98d1) >2012-08-06 13:45:16,824 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-50) [2eadf7b5] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: cb2eea72-dfb3-11e1-89f8-5b30530ef35f Type: VmPool >2012-08-06 13:45:16,963 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [42f796] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 5678ff92 >2012-08-06 13:45:16,964 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [42f796] FINISH, IsValidVDSCommand, return: true, log id: 5678ff92 >2012-08-06 13:45:17,015 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-50) [42f796] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:17,028 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [6a994cf] Lock Acquired to object EngineLock [exclusiveLocks= key: pool1-6 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:17,054 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [6a994cf] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 66469c63 >2012-08-06 13:45:17,056 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [6a994cf] FINISH, IsValidVDSCommand, return: true, log id: 66469c63 >2012-08-06 13:45:17,058 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [6a994cf] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:17,060 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [6a994cf] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 3182b8b6 >2012-08-06 13:45:17,062 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [6a994cf] FINISH, IsValidVDSCommand, return: true, log id: 3182b8b6 >2012-08-06 13:45:17,074 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [6a994cf] MacPoolManager::allocateNewMac entered >2012-08-06 13:45:17,074 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [6a994cf] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:63 >2012-08-06 13:45:17,133 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [6a994cf] Lock freed to object EngineLock [exclusiveLocks= key: pool1-6 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:17,134 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [6a994cf] START, SetVmStatusVDSCommand(vmId = c7702cf0-88da-4885-9b9c-9e59772b3774, status = ImageLocked), log id: 5aa8cfb8 >2012-08-06 13:45:17,141 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [6a994cf] FINISH, SetVmStatusVDSCommand, log id: 5aa8cfb8 >2012-08-06 13:45:17,143 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-50) [641a406e] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 13:45:17,147 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [641a406e] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 60bef491 >2012-08-06 13:45:17,208 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [641a406e] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a851d2e4, log id: 60bef491 >2012-08-06 13:45:17,211 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [641a406e] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = ae9cac27-e90e-48c3-9991-3727f3430079, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 7ea9cddb-39f6-43fd-8eae-2431c021fbaf, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 3e28ef3b >2012-08-06 13:45:17,216 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [641a406e] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 13:45:17,217 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [641a406e] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=ae9cac27-e90e-48c3-9991-3727f3430079 > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=7ea9cddb-39f6-43fd-8eae-2431c021fbaf > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 13:45:17,629 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [641a406e] FINISH, CreateSnapshotVDSCommand, return: 7ea9cddb-39f6-43fd-8eae-2431c021fbaf, log id: 3e28ef3b >2012-08-06 13:45:17,645 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) [641a406e] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity c7702cf0-88da-4885-9b9c-9e59772b3774 >2012-08-06 13:45:17,645 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [641a406e] EntityMultiAsyncTasks::AttachTask: Attaching task de13f018-9b9f-4f88-a340-66700b85c2f9 to entity c7702cf0-88da-4885-9b9c-9e59772b3774. >2012-08-06 13:45:17,647 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-50) [641a406e] Adding task de13f018-9b9f-4f88-a340-66700b85c2f9 to DataBase >2012-08-06 13:45:17,654 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-62) Polling and updating Async Tasks: 5 tasks, 5 tasks to poll now >2012-08-06 13:45:17,709 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-62) SPMAsyncTask::PollTask: Polling task 6421910a-d65f-4365-a942-79329ebc2541 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 13:45:17,735 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-62) BaseAsyncTask::OnTaskEndSuccess: Task 6421910a-d65f-4365-a942-79329ebc2541 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 13:45:17,741 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-62) EntityAsyncTask::EndActionIfNecessary: All tasks of entity a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 has ended -> executing EndAction >2012-08-06 13:45:17,742 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-62) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861): calling EndAction for action type AddVm. >2012-08-06 13:45:17,744 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-62) SPMAsyncTask::PollTask: Polling task 0ca054cd-4d9d-4290-9511-e6b8db6a6cc6 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 13:45:17,744 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 13:45:17,802 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-62) BaseAsyncTask::OnTaskEndSuccess: Task 0ca054cd-4d9d-4290-9511-e6b8db6a6cc6 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 13:45:17,839 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-62) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 6df57989-99a7-4ec9-8f7c-15f222064e61 has ended -> executing EndAction >2012-08-06 13:45:17,840 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-62) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 6df57989-99a7-4ec9-8f7c-15f222064e61): calling EndAction for action type AddVm. >2012-08-06 13:45:17,841 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 13:45:17,842 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-62) SPMAsyncTask::PollTask: Polling task f47de081-04b1-4400-80eb-e5e4e5b2c597 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 13:45:17,879 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-62) BaseAsyncTask::OnTaskEndSuccess: Task f47de081-04b1-4400-80eb-e5e4e5b2c597 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 13:45:17,891 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-62) EntityAsyncTask::EndActionIfNecessary: All tasks of entity d3c805a2-419c-480f-8627-f5c9ef5c4117 has ended -> executing EndAction >2012-08-06 13:45:17,892 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-62) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: d3c805a2-419c-480f-8627-f5c9ef5c4117): calling EndAction for action type AddVm. >2012-08-06 13:45:17,892 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-49) [6d9a5ab8] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 13:45:17,894 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-49) [2ce87751] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 13:45:17,894 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 13:45:17,894 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-62) SPMAsyncTask::PollTask: Polling task b6bea98f-a9ca-4b71-a6c3-19f80db33416 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 13:45:17,922 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-49) [2ce87751] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 12a98932-3b70-4d2f-a157-f42a515563cd, imageId = 16885496-8295-4953-b4cc-cbcb146ddcc0), log id: 57981d89 >2012-08-06 13:45:17,932 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-62) BaseAsyncTask::OnTaskEndSuccess: Task b6bea98f-a9ca-4b71-a6c3-19f80db33416 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 13:45:17,938 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-62) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 3c7c0453-5f05-4314-bdd4-eb4fd243f80a has ended -> executing EndAction >2012-08-06 13:45:17,939 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-62) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 3c7c0453-5f05-4314-bdd4-eb4fd243f80a): calling EndAction for action type AddVm. >2012-08-06 13:45:17,941 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-45) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 13:45:17,947 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-62) SPMAsyncTask::PollTask: Polling task 021febf0-cb7e-4563-8d48-8e70bbad98d1 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2012-08-06 13:45:17,948 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-62) Finished polling Tasks, will poll again in 10 seconds. >2012-08-06 13:45:17,950 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-50) [641a406e] Adding task de13f018-9b9f-4f88-a340-66700b85c2f9 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 13:45:17,969 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-47) [38d94a62] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 13:45:17,974 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-47) [3ae19f28] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 13:45:18,004 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-47) [3ae19f28] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 716ed6d4-2262-46f4-bf30-bf748cb033f4, imageId = 45ebe6b2-2d34-4150-9ec5-0f84e96f5c0e), log id: dd357e9 >2012-08-06 13:45:18,055 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-49) [2ce87751] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@9adb4a32, log id: 57981d89 >2012-08-06 13:45:18,142 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [6256ac86] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 13:45:18,142 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-48) [6743a7c2] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 13:45:18,160 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [6743a7c2] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 558dbca6-df11-44af-86a7-07b8bb79e7ea, imageId = 28dc1eca-24ba-4173-adbf-c758b649892e), log id: 560002dc >2012-08-06 13:45:18,244 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-47) [3ae19f28] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a4b51972, log id: dd357e9 >2012-08-06 13:45:18,299 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-45) [60d6b174] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 13:45:18,300 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-45) [5b17c0c3] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 13:45:18,318 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-45) [5b17c0c3] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = d7801e81-b9b2-4985-acae-7d3ac3e5628e, imageId = 67788645-ff3f-410e-8b5c-161545634ecd), log id: 42ab9b7a >2012-08-06 13:45:18,349 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) [641a406e] BaseAsyncTask::StartPollingTask: Starting to poll task de13f018-9b9f-4f88-a340-66700b85c2f9. >2012-08-06 13:45:18,350 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [641a406e] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity c7702cf0-88da-4885-9b9c-9e59772b3774 is AddVm (determined by task de13f018-9b9f-4f88-a340-66700b85c2f9) >2012-08-06 13:45:18,373 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [6743a7c2] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a3a6b814, log id: 560002dc >2012-08-06 13:45:18,440 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-50) [2b474977] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: cb2eea72-dfb3-11e1-89f8-5b30530ef35f Type: VmPool >2012-08-06 13:45:18,450 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-45) [5b17c0c3] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a937d2d, log id: 42ab9b7a >2012-08-06 13:45:18,488 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-49) START, SetVmStatusVDSCommand(vmId = 6df57989-99a7-4ec9-8f7c-15f222064e61, status = Down), log id: 2807ce32 >2012-08-06 13:45:18,501 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-49) FINISH, SetVmStatusVDSCommand, log id: 2807ce32 >2012-08-06 13:45:18,601 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [70ca9f0a] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: ad4b7ff >2012-08-06 13:45:18,603 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [70ca9f0a] FINISH, IsValidVDSCommand, return: true, log id: ad4b7ff >2012-08-06 13:45:18,776 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-49) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 7f1f0317 >2012-08-06 13:45:18,879 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-49) FINISH, UpdateVMVDSCommand, log id: 7f1f0317 >2012-08-06 13:45:19,058 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) START, SetVmStatusVDSCommand(vmId = d3c805a2-419c-480f-8627-f5c9ef5c4117, status = Down), log id: 4e49499c >2012-08-06 13:45:19,080 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) FINISH, SetVmStatusVDSCommand, log id: 4e49499c >2012-08-06 13:45:19,089 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-50) [70ca9f0a] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:19,107 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [72206b16] Lock Acquired to object EngineLock [exclusiveLocks= key: pool1-7 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:19,124 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 13:45:19,125 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 13:45:19,189 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-47) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 18a5134e >2012-08-06 13:45:19,260 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-49) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 0ca054cd-4d9d-4290-9511-e6b8db6a6cc6 >2012-08-06 13:45:19,264 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-49) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 0ca054cd-4d9d-4290-9511-e6b8db6a6cc6), log id: 45f4dfdd >2012-08-06 13:45:19,428 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-47) FINISH, UpdateVMVDSCommand, log id: 18a5134e >2012-08-06 13:45:19,434 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-49) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=0ca054cd-4d9d-4290-9511-e6b8db6a6cc6), log id: 6c4b0380 >2012-08-06 13:45:19,438 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [72206b16] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6736dc87 >2012-08-06 13:45:19,445 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [72206b16] FINISH, IsValidVDSCommand, return: true, log id: 6736dc87 >2012-08-06 13:45:19,450 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [72206b16] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:19,453 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [72206b16] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 75e75454 >2012-08-06 13:45:19,470 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [72206b16] FINISH, IsValidVDSCommand, return: true, log id: 75e75454 >2012-08-06 13:45:19,517 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 13:45:19,521 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 13:45:19,521 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [72206b16] MacPoolManager::allocateNewMac entered >2012-08-06 13:45:19,525 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [72206b16] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:5a >2012-08-06 13:45:19,558 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-49) FINISH, HSMClearTaskVDSCommand, log id: 6c4b0380 >2012-08-06 13:45:19,559 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-49) FINISH, SPMClearTaskVDSCommand, log id: 45f4dfdd >2012-08-06 13:45:19,613 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) START, SetVmStatusVDSCommand(vmId = a7d2a056-b67b-4bc5-b8ea-7afef2d2b861, status = Down), log id: 7a1cd2fc >2012-08-06 13:45:19,628 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) FINISH, SetVmStatusVDSCommand, log id: 7a1cd2fc >2012-08-06 13:45:19,673 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) SPMAsyncTask::ClearAsyncTask: Attempting to clear task f47de081-04b1-4400-80eb-e5e4e5b2c597 >2012-08-06 13:45:19,674 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-47) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = f47de081-04b1-4400-80eb-e5e4e5b2c597), log id: 9591d45 >2012-08-06 13:45:19,706 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-49) BaseAsyncTask::RemoveTaskFromDB: Removed task 0ca054cd-4d9d-4290-9511-e6b8db6a6cc6 from DataBase >2012-08-06 13:45:19,707 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 6df57989-99a7-4ec9-8f7c-15f222064e61 >2012-08-06 13:45:19,713 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [72206b16] Lock freed to object EngineLock [exclusiveLocks= key: pool1-7 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:19,714 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [72206b16] START, SetVmStatusVDSCommand(vmId = 3ce0f220-6cb8-42d8-b922-7003c60ccdad, status = ImageLocked), log id: 6a249a13 >2012-08-06 13:45:19,726 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [72206b16] FINISH, SetVmStatusVDSCommand, log id: 6a249a13 >2012-08-06 13:45:19,736 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-50) [59944046] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 13:45:19,739 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [59944046] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 3a51e5d5 >2012-08-06 13:45:19,765 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-48) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 448e4a70 >2012-08-06 13:45:19,877 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-47) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=f47de081-04b1-4400-80eb-e5e4e5b2c597), log id: 3b8431c3 >2012-08-06 13:45:19,965 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-47) FINISH, HSMClearTaskVDSCommand, log id: 3b8431c3 >2012-08-06 13:45:19,965 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-47) FINISH, SPMClearTaskVDSCommand, log id: 9591d45 >2012-08-06 13:45:19,999 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) BaseAsyncTask::RemoveTaskFromDB: Removed task f47de081-04b1-4400-80eb-e5e4e5b2c597 from DataBase >2012-08-06 13:45:19,999 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity d3c805a2-419c-480f-8627-f5c9ef5c4117 >2012-08-06 13:45:20,013 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-48) FINISH, UpdateVMVDSCommand, log id: 448e4a70 >2012-08-06 13:45:20,071 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [59944046] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a851d2e4, log id: 3a51e5d5 >2012-08-06 13:45:20,075 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [59944046] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = a0383f76-762c-46fc-a85a-4a621481875f, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 68bd3dcb-6d1e-42fe-8add-0bc6de67bf74, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 7697d49f >2012-08-06 13:45:20,077 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [59944046] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 13:45:20,078 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [59944046] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=a0383f76-762c-46fc-a85a-4a621481875f > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=68bd3dcb-6d1e-42fe-8add-0bc6de67bf74 > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 13:45:20,157 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 13:45:20,158 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 13:45:20,177 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-45) START, SetVmStatusVDSCommand(vmId = 3c7c0453-5f05-4314-bdd4-eb4fd243f80a, status = Down), log id: cbed839 >2012-08-06 13:45:20,187 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-45) FINISH, SetVmStatusVDSCommand, log id: cbed839 >2012-08-06 13:45:20,206 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [59944046] FINISH, CreateSnapshotVDSCommand, return: 68bd3dcb-6d1e-42fe-8add-0bc6de67bf74, log id: 7697d49f >2012-08-06 13:45:20,231 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 6421910a-d65f-4365-a942-79329ebc2541 >2012-08-06 13:45:20,232 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-48) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 6421910a-d65f-4365-a942-79329ebc2541), log id: 2887eed >2012-08-06 13:45:20,239 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-48) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=6421910a-d65f-4365-a942-79329ebc2541), log id: 41125da6 >2012-08-06 13:45:20,242 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) [59944046] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 3ce0f220-6cb8-42d8-b922-7003c60ccdad >2012-08-06 13:45:20,243 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [59944046] EntityMultiAsyncTasks::AttachTask: Attaching task 4573ed65-8094-438f-a525-b0976c726a16 to entity 3ce0f220-6cb8-42d8-b922-7003c60ccdad. >2012-08-06 13:45:20,248 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-50) [59944046] Adding task 4573ed65-8094-438f-a525-b0976c726a16 to DataBase >2012-08-06 13:45:20,318 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 41125da6 >2012-08-06 13:45:20,318 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 2887eed >2012-08-06 13:45:20,348 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task 6421910a-d65f-4365-a942-79329ebc2541 from DataBase >2012-08-06 13:45:20,349 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 >2012-08-06 13:45:20,361 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-45) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 5801691b >2012-08-06 13:45:20,384 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-50) [59944046] Adding task 4573ed65-8094-438f-a525-b0976c726a16 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 13:45:20,486 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-45) FINISH, UpdateVMVDSCommand, log id: 5801691b >2012-08-06 13:45:20,540 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-45) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 13:45:20,541 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-45) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 13:45:20,612 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-45) SPMAsyncTask::ClearAsyncTask: Attempting to clear task b6bea98f-a9ca-4b71-a6c3-19f80db33416 >2012-08-06 13:45:20,613 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-45) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = b6bea98f-a9ca-4b71-a6c3-19f80db33416), log id: 2765d8 >2012-08-06 13:45:20,617 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-45) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=b6bea98f-a9ca-4b71-a6c3-19f80db33416), log id: 5106e74f >2012-08-06 13:45:20,698 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-45) FINISH, HSMClearTaskVDSCommand, log id: 5106e74f >2012-08-06 13:45:20,699 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-45) FINISH, SPMClearTaskVDSCommand, log id: 2765d8 >2012-08-06 13:45:20,738 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-45) BaseAsyncTask::RemoveTaskFromDB: Removed task b6bea98f-a9ca-4b71-a6c3-19f80db33416 from DataBase >2012-08-06 13:45:20,739 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-45) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 3c7c0453-5f05-4314-bdd4-eb4fd243f80a >2012-08-06 13:45:20,812 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) [59944046] BaseAsyncTask::StartPollingTask: Starting to poll task 4573ed65-8094-438f-a525-b0976c726a16. >2012-08-06 13:45:20,813 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [59944046] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 3ce0f220-6cb8-42d8-b922-7003c60ccdad is AddVm (determined by task 4573ed65-8094-438f-a525-b0976c726a16) >2012-08-06 13:45:20,833 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-50) [10a13ef0] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: cb2eea72-dfb3-11e1-89f8-5b30530ef35f Type: VmPool >2012-08-06 13:45:20,947 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [492b0413] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 72bde1c6 >2012-08-06 13:45:20,954 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [492b0413] FINISH, IsValidVDSCommand, return: true, log id: 72bde1c6 >2012-08-06 13:45:21,004 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-50) [492b0413] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:21,020 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [37c56e5f] Lock Acquired to object EngineLock [exclusiveLocks= key: pool1-8 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:21,108 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [37c56e5f] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 2a9dab63 >2012-08-06 13:45:21,111 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [37c56e5f] FINISH, IsValidVDSCommand, return: true, log id: 2a9dab63 >2012-08-06 13:45:21,113 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [37c56e5f] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:21,116 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [37c56e5f] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 293a6c4b >2012-08-06 13:45:21,118 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [37c56e5f] FINISH, IsValidVDSCommand, return: true, log id: 293a6c4b >2012-08-06 13:45:21,129 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [37c56e5f] MacPoolManager::allocateNewMac entered >2012-08-06 13:45:21,130 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [37c56e5f] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:5f >2012-08-06 13:45:21,172 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [37c56e5f] Lock freed to object EngineLock [exclusiveLocks= key: pool1-8 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:21,173 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [37c56e5f] START, SetVmStatusVDSCommand(vmId = 96405d4a-a3bd-4900-ab90-9c8736cb02a5, status = ImageLocked), log id: 11f585b1 >2012-08-06 13:45:21,180 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [37c56e5f] FINISH, SetVmStatusVDSCommand, log id: 11f585b1 >2012-08-06 13:45:21,182 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-50) [7fe4f07f] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 13:45:21,190 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [7fe4f07f] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 1910a619 >2012-08-06 13:45:21,251 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [7fe4f07f] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a851d2e4, log id: 1910a619 >2012-08-06 13:45:21,254 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [7fe4f07f] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 4a2ba0e7-a428-4859-bac7-c48b69233e60, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 4e72a178-3a33-462e-97c1-b9d3830bfc04, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 37d8e180 >2012-08-06 13:45:21,255 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [7fe4f07f] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 13:45:21,258 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [7fe4f07f] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=4a2ba0e7-a428-4859-bac7-c48b69233e60 > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=4e72a178-3a33-462e-97c1-b9d3830bfc04 > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 13:45:21,666 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [7fe4f07f] FINISH, CreateSnapshotVDSCommand, return: 4e72a178-3a33-462e-97c1-b9d3830bfc04, log id: 37d8e180 >2012-08-06 13:45:21,695 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) [7fe4f07f] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 96405d4a-a3bd-4900-ab90-9c8736cb02a5 >2012-08-06 13:45:21,696 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [7fe4f07f] EntityMultiAsyncTasks::AttachTask: Attaching task 0e222300-c6ef-4a94-b3ce-893454fb1473 to entity 96405d4a-a3bd-4900-ab90-9c8736cb02a5. >2012-08-06 13:45:21,698 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-50) [7fe4f07f] Adding task 0e222300-c6ef-4a94-b3ce-893454fb1473 to DataBase >2012-08-06 13:45:21,781 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-50) [7fe4f07f] Adding task 0e222300-c6ef-4a94-b3ce-893454fb1473 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 13:45:22,132 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) [7fe4f07f] BaseAsyncTask::StartPollingTask: Starting to poll task 0e222300-c6ef-4a94-b3ce-893454fb1473. >2012-08-06 13:45:22,132 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [7fe4f07f] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 96405d4a-a3bd-4900-ab90-9c8736cb02a5 is AddVm (determined by task 0e222300-c6ef-4a94-b3ce-893454fb1473) >2012-08-06 13:45:22,145 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-50) [42f3c7d3] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: cb2eea72-dfb3-11e1-89f8-5b30530ef35f Type: VmPool >2012-08-06 13:45:22,228 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [6cf7d000] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 477bd6e9 >2012-08-06 13:45:22,230 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [6cf7d000] FINISH, IsValidVDSCommand, return: true, log id: 477bd6e9 >2012-08-06 13:45:22,318 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-50) [6cf7d000] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:22,329 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [2f923d0e] Lock Acquired to object EngineLock [exclusiveLocks= key: pool1-9 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:22,364 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [2f923d0e] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 2d098b44 >2012-08-06 13:45:22,366 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [2f923d0e] FINISH, IsValidVDSCommand, return: true, log id: 2d098b44 >2012-08-06 13:45:22,371 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [2f923d0e] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:22,376 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [2f923d0e] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 7578ab04 >2012-08-06 13:45:22,378 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [2f923d0e] FINISH, IsValidVDSCommand, return: true, log id: 7578ab04 >2012-08-06 13:45:22,387 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [2f923d0e] MacPoolManager::allocateNewMac entered >2012-08-06 13:45:22,387 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [2f923d0e] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:5d >2012-08-06 13:45:22,425 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [2f923d0e] Lock freed to object EngineLock [exclusiveLocks= key: pool1-9 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:22,426 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [2f923d0e] START, SetVmStatusVDSCommand(vmId = 8738bb81-c73e-4a41-a24a-c4c49491c536, status = ImageLocked), log id: 70ccc5fd >2012-08-06 13:45:22,430 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [2f923d0e] FINISH, SetVmStatusVDSCommand, log id: 70ccc5fd >2012-08-06 13:45:22,431 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-50) [228ca972] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 13:45:22,433 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [228ca972] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 29864c2e >2012-08-06 13:45:22,509 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [228ca972] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a851d2e4, log id: 29864c2e >2012-08-06 13:45:22,512 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [228ca972] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 23c850b9-0278-4cb8-8ef3-ee8939c1bc06, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = a577575b-4550-4dcb-a2c2-71f511c02c89, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 1a6be3f8 >2012-08-06 13:45:22,514 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [228ca972] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 13:45:22,514 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [228ca972] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=23c850b9-0278-4cb8-8ef3-ee8939c1bc06 > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=a577575b-4550-4dcb-a2c2-71f511c02c89 > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 13:45:22,988 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [228ca972] FINISH, CreateSnapshotVDSCommand, return: a577575b-4550-4dcb-a2c2-71f511c02c89, log id: 1a6be3f8 >2012-08-06 13:45:23,010 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) [228ca972] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 8738bb81-c73e-4a41-a24a-c4c49491c536 >2012-08-06 13:45:23,011 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [228ca972] EntityMultiAsyncTasks::AttachTask: Attaching task 79a0d5a4-d091-4e5d-8168-17d09e22c688 to entity 8738bb81-c73e-4a41-a24a-c4c49491c536. >2012-08-06 13:45:23,012 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-50) [228ca972] Adding task 79a0d5a4-d091-4e5d-8168-17d09e22c688 to DataBase >2012-08-06 13:45:23,128 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-50) [228ca972] Adding task 79a0d5a4-d091-4e5d-8168-17d09e22c688 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 13:45:23,361 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) [228ca972] BaseAsyncTask::StartPollingTask: Starting to poll task 79a0d5a4-d091-4e5d-8168-17d09e22c688. >2012-08-06 13:45:23,362 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [228ca972] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 8738bb81-c73e-4a41-a24a-c4c49491c536 is AddVm (determined by task 79a0d5a4-d091-4e5d-8168-17d09e22c688) >2012-08-06 13:45:23,373 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-50) [5f0b2f7] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: cb2eea72-dfb3-11e1-89f8-5b30530ef35f Type: VmPool >2012-08-06 13:45:23,484 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [47a9cb9d] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4fb65fd6 >2012-08-06 13:45:23,486 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [47a9cb9d] FINISH, IsValidVDSCommand, return: true, log id: 4fb65fd6 >2012-08-06 13:45:23,533 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-50) [47a9cb9d] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:23,553 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [643c8f7c] Lock Acquired to object EngineLock [exclusiveLocks= key: pool1-10 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:23,623 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [643c8f7c] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 314153b6 >2012-08-06 13:45:23,624 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [643c8f7c] FINISH, IsValidVDSCommand, return: true, log id: 314153b6 >2012-08-06 13:45:23,626 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [643c8f7c] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:23,627 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [643c8f7c] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 2305780e >2012-08-06 13:45:23,632 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [643c8f7c] FINISH, IsValidVDSCommand, return: true, log id: 2305780e >2012-08-06 13:45:23,641 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [643c8f7c] MacPoolManager::allocateNewMac entered >2012-08-06 13:45:23,641 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [643c8f7c] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:5e >2012-08-06 13:45:23,689 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [643c8f7c] Lock freed to object EngineLock [exclusiveLocks= key: pool1-10 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:23,689 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [643c8f7c] START, SetVmStatusVDSCommand(vmId = 6a729fb0-47fe-4eba-9ba3-2b939eee2b19, status = ImageLocked), log id: 48d714ec >2012-08-06 13:45:23,695 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [643c8f7c] FINISH, SetVmStatusVDSCommand, log id: 48d714ec >2012-08-06 13:45:23,697 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-50) [35b1d37] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 13:45:23,701 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [35b1d37] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 3b509314 >2012-08-06 13:45:23,758 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [35b1d37] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a851d2e4, log id: 3b509314 >2012-08-06 13:45:23,761 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [35b1d37] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 72fb765c-6215-4011-84ba-f85696ff14df, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 2d939f22-00ff-43b9-bf4c-e51f03a245bb, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 17bf8b1c >2012-08-06 13:45:23,763 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [35b1d37] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 13:45:23,764 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [35b1d37] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=72fb765c-6215-4011-84ba-f85696ff14df > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=2d939f22-00ff-43b9-bf4c-e51f03a245bb > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 13:45:24,352 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [35b1d37] FINISH, CreateSnapshotVDSCommand, return: 2d939f22-00ff-43b9-bf4c-e51f03a245bb, log id: 17bf8b1c >2012-08-06 13:45:24,365 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) [35b1d37] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 >2012-08-06 13:45:24,366 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [35b1d37] EntityMultiAsyncTasks::AttachTask: Attaching task 24e380c9-7f30-4487-b5a9-fe4f9d4a180a to entity 6a729fb0-47fe-4eba-9ba3-2b939eee2b19. >2012-08-06 13:45:24,367 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-50) [35b1d37] Adding task 24e380c9-7f30-4487-b5a9-fe4f9d4a180a to DataBase >2012-08-06 13:45:24,479 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-50) [35b1d37] Adding task 24e380c9-7f30-4487-b5a9-fe4f9d4a180a (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 13:45:24,763 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) [35b1d37] BaseAsyncTask::StartPollingTask: Starting to poll task 24e380c9-7f30-4487-b5a9-fe4f9d4a180a. >2012-08-06 13:45:24,764 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [35b1d37] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 is AddVm (determined by task 24e380c9-7f30-4487-b5a9-fe4f9d4a180a) >2012-08-06 13:45:24,778 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-50) [15d800ca] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: cb2eea72-dfb3-11e1-89f8-5b30530ef35f Type: VmPool >2012-08-06 13:45:24,976 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [3469aca0] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1b976f40 >2012-08-06 13:45:24,977 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [3469aca0] FINISH, IsValidVDSCommand, return: true, log id: 1b976f40 >2012-08-06 13:45:25,093 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-50) [3469aca0] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:25,102 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [69b11c9f] Lock Acquired to object EngineLock [exclusiveLocks= key: pool1-11 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:25,117 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [69b11c9f] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4b66e9e7 >2012-08-06 13:45:25,119 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [69b11c9f] FINISH, IsValidVDSCommand, return: true, log id: 4b66e9e7 >2012-08-06 13:45:25,120 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [69b11c9f] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:25,122 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [69b11c9f] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4dc0be46 >2012-08-06 13:45:25,123 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [69b11c9f] FINISH, IsValidVDSCommand, return: true, log id: 4dc0be46 >2012-08-06 13:45:25,135 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [69b11c9f] MacPoolManager::allocateNewMac entered >2012-08-06 13:45:25,135 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [69b11c9f] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:5b >2012-08-06 13:45:25,171 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [69b11c9f] Lock freed to object EngineLock [exclusiveLocks= key: pool1-11 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:25,172 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [69b11c9f] START, SetVmStatusVDSCommand(vmId = 9dbe6b1e-2a98-449e-8bd7-2d025c420a42, status = ImageLocked), log id: 64e3f51 >2012-08-06 13:45:25,178 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [69b11c9f] FINISH, SetVmStatusVDSCommand, log id: 64e3f51 >2012-08-06 13:45:25,180 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-50) [4882a683] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 13:45:25,185 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [4882a683] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 7c916e5b >2012-08-06 13:45:25,240 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [4882a683] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a851d2e4, log id: 7c916e5b >2012-08-06 13:45:25,243 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [4882a683] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = b71e5cca-0cb0-4a6c-9be6-b66a2991cd93, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 50efadf7-60c6-483a-93d8-b679dc268947, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 158ed0a6 >2012-08-06 13:45:25,245 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [4882a683] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 13:45:25,245 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [4882a683] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=b71e5cca-0cb0-4a6c-9be6-b66a2991cd93 > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=50efadf7-60c6-483a-93d8-b679dc268947 > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 13:45:25,612 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [4882a683] FINISH, CreateSnapshotVDSCommand, return: 50efadf7-60c6-483a-93d8-b679dc268947, log id: 158ed0a6 >2012-08-06 13:45:25,667 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) [4882a683] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 >2012-08-06 13:45:25,668 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [4882a683] EntityMultiAsyncTasks::AttachTask: Attaching task 29ab0248-1ed3-464b-8280-ea0159164662 to entity 9dbe6b1e-2a98-449e-8bd7-2d025c420a42. >2012-08-06 13:45:25,669 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-50) [4882a683] Adding task 29ab0248-1ed3-464b-8280-ea0159164662 to DataBase >2012-08-06 13:45:25,734 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-50) [4882a683] Adding task 29ab0248-1ed3-464b-8280-ea0159164662 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 13:45:25,889 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) [4882a683] BaseAsyncTask::StartPollingTask: Starting to poll task 29ab0248-1ed3-464b-8280-ea0159164662. >2012-08-06 13:45:25,890 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [4882a683] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 is AddVm (determined by task 29ab0248-1ed3-464b-8280-ea0159164662) >2012-08-06 13:45:25,903 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-50) [6816a1f2] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: cb2eea72-dfb3-11e1-89f8-5b30530ef35f Type: VmPool >2012-08-06 13:45:26,012 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [3abad78a] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4a87a544 >2012-08-06 13:45:26,013 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [3abad78a] FINISH, IsValidVDSCommand, return: true, log id: 4a87a544 >2012-08-06 13:45:26,117 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-50) [3abad78a] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:26,130 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [5093c6c7] Lock Acquired to object EngineLock [exclusiveLocks= key: pool1-12 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:26,169 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [5093c6c7] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 51b27b2b >2012-08-06 13:45:26,170 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [5093c6c7] FINISH, IsValidVDSCommand, return: true, log id: 51b27b2b >2012-08-06 13:45:26,172 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [5093c6c7] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:26,173 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [5093c6c7] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6b2168c0 >2012-08-06 13:45:26,174 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [5093c6c7] FINISH, IsValidVDSCommand, return: true, log id: 6b2168c0 >2012-08-06 13:45:26,179 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [5093c6c7] MacPoolManager::allocateNewMac entered >2012-08-06 13:45:26,179 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [5093c6c7] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:5c >2012-08-06 13:45:26,222 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [5093c6c7] Lock freed to object EngineLock [exclusiveLocks= key: pool1-12 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:26,223 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [5093c6c7] START, SetVmStatusVDSCommand(vmId = e5a192f1-3f9d-48e1-a817-28f72815c646, status = ImageLocked), log id: 1fe4be49 >2012-08-06 13:45:26,229 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [5093c6c7] FINISH, SetVmStatusVDSCommand, log id: 1fe4be49 >2012-08-06 13:45:26,234 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-50) [7b7ed051] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 13:45:26,237 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [7b7ed051] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 364e20dc >2012-08-06 13:45:26,306 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [7b7ed051] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a851d2e4, log id: 364e20dc >2012-08-06 13:45:26,309 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [7b7ed051] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = ece735c2-0ab3-4e87-80b3-18d4034c9b6f, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 2bda6b70-f607-4757-bbbc-7f5df5875938, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 4c32a807 >2012-08-06 13:45:26,311 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [7b7ed051] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 13:45:26,317 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [7b7ed051] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=ece735c2-0ab3-4e87-80b3-18d4034c9b6f > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=2bda6b70-f607-4757-bbbc-7f5df5875938 > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 13:45:26,773 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [7b7ed051] FINISH, CreateSnapshotVDSCommand, return: 2bda6b70-f607-4757-bbbc-7f5df5875938, log id: 4c32a807 >2012-08-06 13:45:26,796 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) [7b7ed051] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity e5a192f1-3f9d-48e1-a817-28f72815c646 >2012-08-06 13:45:26,796 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [7b7ed051] EntityMultiAsyncTasks::AttachTask: Attaching task 5d4b44c3-1b94-4648-ac62-d474ca0390df to entity e5a192f1-3f9d-48e1-a817-28f72815c646. >2012-08-06 13:45:26,798 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-50) [7b7ed051] Adding task 5d4b44c3-1b94-4648-ac62-d474ca0390df to DataBase >2012-08-06 13:45:26,857 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-50) [7b7ed051] Adding task 5d4b44c3-1b94-4648-ac62-d474ca0390df (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 13:45:27,094 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) [7b7ed051] BaseAsyncTask::StartPollingTask: Starting to poll task 5d4b44c3-1b94-4648-ac62-d474ca0390df. >2012-08-06 13:45:27,095 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [7b7ed051] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity e5a192f1-3f9d-48e1-a817-28f72815c646 is AddVm (determined by task 5d4b44c3-1b94-4648-ac62-d474ca0390df) >2012-08-06 13:45:27,110 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-50) [599736ce] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: cb2eea72-dfb3-11e1-89f8-5b30530ef35f Type: VmPool >2012-08-06 13:45:27,248 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [2601258a] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 7626ee87 >2012-08-06 13:45:27,250 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [2601258a] FINISH, IsValidVDSCommand, return: true, log id: 7626ee87 >2012-08-06 13:45:27,330 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-50) [2601258a] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:27,342 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [3f234868] Lock Acquired to object EngineLock [exclusiveLocks= key: pool1-13 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:27,371 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [3f234868] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1332a1a4 >2012-08-06 13:45:27,372 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [3f234868] FINISH, IsValidVDSCommand, return: true, log id: 1332a1a4 >2012-08-06 13:45:27,374 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [3f234868] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:27,378 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [3f234868] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 457e1ed7 >2012-08-06 13:45:27,380 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [3f234868] FINISH, IsValidVDSCommand, return: true, log id: 457e1ed7 >2012-08-06 13:45:27,390 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [3f234868] MacPoolManager::allocateNewMac entered >2012-08-06 13:45:27,391 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [3f234868] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:72 >2012-08-06 13:45:27,428 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [3f234868] Lock freed to object EngineLock [exclusiveLocks= key: pool1-13 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:27,428 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [3f234868] START, SetVmStatusVDSCommand(vmId = 6c1fcddf-86d6-4533-905b-abb11b775f5b, status = ImageLocked), log id: 6bc46678 >2012-08-06 13:45:27,432 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [3f234868] FINISH, SetVmStatusVDSCommand, log id: 6bc46678 >2012-08-06 13:45:27,438 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-50) [1c17acc] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 13:45:27,440 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [1c17acc] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 7b6de965 >2012-08-06 13:45:27,498 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [1c17acc] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a851d2e4, log id: 7b6de965 >2012-08-06 13:45:27,500 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [1c17acc] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 1f44779b-3d85-488d-ab69-5ea6d9879ded, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = ca017c58-eab0-4eb4-9f60-ff9382cacae1, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: efa7632 >2012-08-06 13:45:27,502 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [1c17acc] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 13:45:27,503 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [1c17acc] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=1f44779b-3d85-488d-ab69-5ea6d9879ded > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=ca017c58-eab0-4eb4-9f60-ff9382cacae1 > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 13:45:27,816 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [1c17acc] FINISH, CreateSnapshotVDSCommand, return: ca017c58-eab0-4eb4-9f60-ff9382cacae1, log id: efa7632 >2012-08-06 13:45:27,840 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) [1c17acc] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 6c1fcddf-86d6-4533-905b-abb11b775f5b >2012-08-06 13:45:27,840 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [1c17acc] EntityMultiAsyncTasks::AttachTask: Attaching task b1bdb85e-efd9-42ca-8f19-a5c97d45ae9c to entity 6c1fcddf-86d6-4533-905b-abb11b775f5b. >2012-08-06 13:45:27,842 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-50) [1c17acc] Adding task b1bdb85e-efd9-42ca-8f19-a5c97d45ae9c to DataBase >2012-08-06 13:45:27,904 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-50) [1c17acc] Adding task b1bdb85e-efd9-42ca-8f19-a5c97d45ae9c (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 13:45:27,964 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-86) Polling and updating Async Tasks: 13 tasks, 8 tasks to poll now >2012-08-06 13:45:28,031 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-86) SPMAsyncTask::PollTask: Polling task 4573ed65-8094-438f-a525-b0976c726a16 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 13:45:28,081 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-86) BaseAsyncTask::OnTaskEndSuccess: Task 4573ed65-8094-438f-a525-b0976c726a16 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 13:45:28,100 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-86) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 3ce0f220-6cb8-42d8-b922-7003c60ccdad has ended -> executing EndAction >2012-08-06 13:45:28,101 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-86) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 3ce0f220-6cb8-42d8-b922-7003c60ccdad): calling EndAction for action type AddVm. >2012-08-06 13:45:28,102 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-45) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 13:45:28,104 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-86) SPMAsyncTask::PollTask: Polling task 021febf0-cb7e-4563-8d48-8e70bbad98d1 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 13:45:28,124 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-86) BaseAsyncTask::OnTaskEndSuccess: Task 021febf0-cb7e-4563-8d48-8e70bbad98d1 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 13:45:28,126 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-86) EntityAsyncTask::EndActionIfNecessary: All tasks of entity c1cb365c-a119-493c-964c-faf65a10c889 has ended -> executing EndAction >2012-08-06 13:45:28,127 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-86) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: c1cb365c-a119-493c-964c-faf65a10c889): calling EndAction for action type AddVm. >2012-08-06 13:45:28,127 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 13:45:28,129 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-86) SPMAsyncTask::PollTask: Polling task 0e222300-c6ef-4a94-b3ce-893454fb1473 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 13:45:28,147 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-45) [72206b16] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 13:45:28,148 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-45) [59944046] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 13:45:28,161 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-86) BaseAsyncTask::OnTaskEndSuccess: Task 0e222300-c6ef-4a94-b3ce-893454fb1473 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 13:45:28,164 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-86) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 96405d4a-a3bd-4900-ab90-9c8736cb02a5 has ended -> executing EndAction >2012-08-06 13:45:28,164 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-86) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 96405d4a-a3bd-4900-ab90-9c8736cb02a5): calling EndAction for action type AddVm. >2012-08-06 13:45:28,165 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 13:45:28,167 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-86) SPMAsyncTask::PollTask: Polling task de13f018-9b9f-4f88-a340-66700b85c2f9 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 13:45:28,185 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-45) [59944046] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = a0383f76-762c-46fc-a85a-4a621481875f, imageId = 68bd3dcb-6d1e-42fe-8add-0bc6de67bf74), log id: 33d7fdca >2012-08-06 13:45:28,200 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-48) [72dcaaca] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 13:45:28,200 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-48) [54359687] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 13:45:28,214 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [54359687] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 94269f14-e5b7-4fa9-90ea-7eda93dee529, imageId = cb6c00f6-d37e-4a23-9992-2ad1f8716b6f), log id: 1c065000 >2012-08-06 13:45:28,217 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-86) BaseAsyncTask::OnTaskEndSuccess: Task de13f018-9b9f-4f88-a340-66700b85c2f9 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 13:45:28,240 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-86) EntityAsyncTask::EndActionIfNecessary: All tasks of entity c7702cf0-88da-4885-9b9c-9e59772b3774 has ended -> executing EndAction >2012-08-06 13:45:28,241 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-86) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: c7702cf0-88da-4885-9b9c-9e59772b3774): calling EndAction for action type AddVm. >2012-08-06 13:45:28,242 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 13:45:28,243 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-86) SPMAsyncTask::PollTask: Polling task 5d4b44c3-1b94-4648-ac62-d474ca0390df (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2012-08-06 13:45:28,244 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-86) SPMAsyncTask::PollTask: Polling task 29ab0248-1ed3-464b-8280-ea0159164662 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 13:45:28,294 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-86) BaseAsyncTask::OnTaskEndSuccess: Task 29ab0248-1ed3-464b-8280-ea0159164662 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 13:45:28,347 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-45) [59944046] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@62dfae28, log id: 33d7fdca >2012-08-06 13:45:28,354 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-86) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 has ended -> executing EndAction >2012-08-06 13:45:28,355 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-86) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42): calling EndAction for action type AddVm. >2012-08-06 13:45:28,356 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-86) SPMAsyncTask::PollTask: Polling task 24e380c9-7f30-4487-b5a9-fe4f9d4a180a (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 13:45:28,358 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-46) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 13:45:28,386 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-86) BaseAsyncTask::OnTaskEndSuccess: Task 24e380c9-7f30-4487-b5a9-fe4f9d4a180a (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 13:45:28,387 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-86) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 has ended -> executing EndAction >2012-08-06 13:45:28,395 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-86) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19): calling EndAction for action type AddVm. >2012-08-06 13:45:28,407 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-43) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 13:45:28,411 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-86) SPMAsyncTask::PollTask: Polling task 79a0d5a4-d091-4e5d-8168-17d09e22c688 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 13:45:28,450 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-86) BaseAsyncTask::OnTaskEndSuccess: Task 79a0d5a4-d091-4e5d-8168-17d09e22c688 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 13:45:28,451 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-86) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 8738bb81-c73e-4a41-a24a-c4c49491c536 has ended -> executing EndAction >2012-08-06 13:45:28,451 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-86) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 8738bb81-c73e-4a41-a24a-c4c49491c536): calling EndAction for action type AddVm. >2012-08-06 13:45:28,467 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 13:45:28,469 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-86) Finished polling Tasks, will poll again in 10 seconds. >2012-08-06 13:45:28,514 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) [54359687] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@f54d15a3, log id: 1c065000 >2012-08-06 13:45:28,620 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) [1c17acc] BaseAsyncTask::StartPollingTask: Starting to poll task b1bdb85e-efd9-42ca-8f19-a5c97d45ae9c. >2012-08-06 13:45:28,621 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [1c17acc] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 6c1fcddf-86d6-4533-905b-abb11b775f5b is AddVm (determined by task b1bdb85e-efd9-42ca-8f19-a5c97d45ae9c) >2012-08-06 13:45:28,688 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-46) [69b11c9f] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 13:45:28,690 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-46) [4882a683] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 13:45:28,709 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-44) [37c56e5f] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 13:45:28,710 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-44) [7fe4f07f] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 13:45:28,717 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-46) [4882a683] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = b71e5cca-0cb0-4a6c-9be6-b66a2991cd93, imageId = 50efadf7-60c6-483a-93d8-b679dc268947), log id: 7a1ef058 >2012-08-06 13:45:28,741 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-44) [7fe4f07f] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 4a2ba0e7-a428-4859-bac7-c48b69233e60, imageId = 4e72a178-3a33-462e-97c1-b9d3830bfc04), log id: 436cd34b >2012-08-06 13:45:28,784 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-49) [6a994cf] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 13:45:28,785 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-49) [641a406e] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 13:45:28,800 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-42) [2f923d0e] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 13:45:28,801 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-42) [228ca972] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 13:45:28,822 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-42) [228ca972] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 23c850b9-0278-4cb8-8ef3-ee8939c1bc06, imageId = a577575b-4550-4dcb-a2c2-71f511c02c89), log id: 18302302 >2012-08-06 13:45:28,827 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-46) [4882a683] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@d89c103c, log id: 7a1ef058 >2012-08-06 13:45:28,839 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-49) [641a406e] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = ae9cac27-e90e-48c3-9991-3727f3430079, imageId = 7ea9cddb-39f6-43fd-8eae-2431c021fbaf), log id: 28491d6b >2012-08-06 13:45:28,843 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-43) [643c8f7c] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 13:45:28,844 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-43) [35b1d37] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 13:45:28,871 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-43) [35b1d37] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 72fb765c-6215-4011-84ba-f85696ff14df, imageId = 2d939f22-00ff-43b9-bf4c-e51f03a245bb), log id: 5c19eab5 >2012-08-06 13:45:28,958 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-42) [228ca972] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@98f64ae4, log id: 18302302 >2012-08-06 13:45:29,041 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-50) [2428f4f6] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: cb2eea72-dfb3-11e1-89f8-5b30530ef35f Type: VmPool >2012-08-06 13:45:29,065 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-44) [7fe4f07f] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@5a4a27c0, log id: 436cd34b >2012-08-06 13:45:29,077 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-45) START, SetVmStatusVDSCommand(vmId = 3ce0f220-6cb8-42d8-b922-7003c60ccdad, status = Down), log id: 3431392a >2012-08-06 13:45:29,119 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-45) FINISH, SetVmStatusVDSCommand, log id: 3431392a >2012-08-06 13:45:29,175 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-43) [35b1d37] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@3bbee1ed, log id: 5c19eab5 >2012-08-06 13:45:29,243 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-45) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 1d39287a >2012-08-06 13:45:29,252 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-49) [641a406e] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@43b337dc, log id: 28491d6b >2012-08-06 13:45:29,276 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [5490eda2] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 418e625b >2012-08-06 13:45:29,278 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [5490eda2] FINISH, IsValidVDSCommand, return: true, log id: 418e625b >2012-08-06 13:45:29,330 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-45) FINISH, UpdateVMVDSCommand, log id: 1d39287a >2012-08-06 13:45:29,347 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-50) [5490eda2] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:29,379 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) START, SetVmStatusVDSCommand(vmId = c1cb365c-a119-493c-964c-faf65a10c889, status = Down), log id: 29ade59c >2012-08-06 13:45:29,387 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [4db547ee] Lock Acquired to object EngineLock [exclusiveLocks= key: pool1-14 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:29,401 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-45) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 13:45:29,402 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-45) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 13:45:29,410 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) FINISH, SetVmStatusVDSCommand, log id: 29ade59c >2012-08-06 13:45:29,434 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-45) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 4573ed65-8094-438f-a525-b0976c726a16 >2012-08-06 13:45:29,435 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-45) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 4573ed65-8094-438f-a525-b0976c726a16), log id: 1f9039b >2012-08-06 13:45:29,437 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-45) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=4573ed65-8094-438f-a525-b0976c726a16), log id: 2a847b5f >2012-08-06 13:45:29,487 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-48) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 6fc649a8 >2012-08-06 13:45:29,523 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-45) FINISH, HSMClearTaskVDSCommand, log id: 2a847b5f >2012-08-06 13:45:29,523 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-45) FINISH, SPMClearTaskVDSCommand, log id: 1f9039b >2012-08-06 13:45:29,574 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-45) BaseAsyncTask::RemoveTaskFromDB: Removed task 4573ed65-8094-438f-a525-b0976c726a16 from DataBase >2012-08-06 13:45:29,575 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-45) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 3ce0f220-6cb8-42d8-b922-7003c60ccdad >2012-08-06 13:45:29,680 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-48) FINISH, UpdateVMVDSCommand, log id: 6fc649a8 >2012-08-06 13:45:29,716 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [4db547ee] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 5ab9b7bc >2012-08-06 13:45:29,738 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [4db547ee] FINISH, IsValidVDSCommand, return: true, log id: 5ab9b7bc >2012-08-06 13:45:29,741 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [4db547ee] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:29,753 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [4db547ee] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 46f0cec2 >2012-08-06 13:45:29,762 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [4db547ee] FINISH, IsValidVDSCommand, return: true, log id: 46f0cec2 >2012-08-06 13:45:29,781 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [4db547ee] MacPoolManager::allocateNewMac entered >2012-08-06 13:45:29,781 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [4db547ee] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:73 >2012-08-06 13:45:29,786 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 13:45:29,787 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 13:45:29,819 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-46) START, SetVmStatusVDSCommand(vmId = 9dbe6b1e-2a98-449e-8bd7-2d025c420a42, status = Down), log id: 3689803a >2012-08-06 13:45:29,827 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-46) FINISH, SetVmStatusVDSCommand, log id: 3689803a >2012-08-06 13:45:29,834 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 021febf0-cb7e-4563-8d48-8e70bbad98d1 >2012-08-06 13:45:29,835 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-48) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 021febf0-cb7e-4563-8d48-8e70bbad98d1), log id: e7fd4d4 >2012-08-06 13:45:29,868 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-48) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=021febf0-cb7e-4563-8d48-8e70bbad98d1), log id: 5f3f8af4 >2012-08-06 13:45:29,976 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-46) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 1f2d7ca3 >2012-08-06 13:45:29,984 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 5f3f8af4 >2012-08-06 13:45:29,984 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-48) FINISH, SPMClearTaskVDSCommand, log id: e7fd4d4 >2012-08-06 13:45:29,986 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [4db547ee] Lock freed to object EngineLock [exclusiveLocks= key: pool1-14 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:29,987 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [4db547ee] START, SetVmStatusVDSCommand(vmId = 2842672f-6230-434f-8232-e88e71560092, status = ImageLocked), log id: 5ad9cc80 >2012-08-06 13:45:29,996 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task 021febf0-cb7e-4563-8d48-8e70bbad98d1 from DataBase >2012-08-06 13:45:29,997 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity c1cb365c-a119-493c-964c-faf65a10c889 >2012-08-06 13:45:29,999 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [4db547ee] FINISH, SetVmStatusVDSCommand, log id: 5ad9cc80 >2012-08-06 13:45:30,009 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-50) [4f5c1b39] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 13:45:30,022 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [4f5c1b39] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 6ea95987 >2012-08-06 13:45:30,090 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-46) FINISH, UpdateVMVDSCommand, log id: 1f2d7ca3 >2012-08-06 13:45:30,156 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-46) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 13:45:30,157 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-46) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 13:45:30,176 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [4f5c1b39] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a851d2e4, log id: 6ea95987 >2012-08-06 13:45:30,179 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [4f5c1b39] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = ff42535f-42bf-41e4-ba8a-978f426fdab9, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = a0f3dfa1-eaba-4a3d-8d94-e6c30f927d4e, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 4e97891b >2012-08-06 13:45:30,181 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [4f5c1b39] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 13:45:30,188 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [4f5c1b39] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=ff42535f-42bf-41e4-ba8a-978f426fdab9 > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=a0f3dfa1-eaba-4a3d-8d94-e6c30f927d4e > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 13:45:30,196 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-42) START, SetVmStatusVDSCommand(vmId = 8738bb81-c73e-4a41-a24a-c4c49491c536, status = Down), log id: 4fd8f7e2 >2012-08-06 13:45:30,206 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-42) FINISH, SetVmStatusVDSCommand, log id: 4fd8f7e2 >2012-08-06 13:45:30,218 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-46) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 29ab0248-1ed3-464b-8280-ea0159164662 >2012-08-06 13:45:30,222 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-46) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 29ab0248-1ed3-464b-8280-ea0159164662), log id: 40dca3a8 >2012-08-06 13:45:30,280 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-42) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: c3df6a3 >2012-08-06 13:45:30,500 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [4f5c1b39] FINISH, CreateSnapshotVDSCommand, return: a0f3dfa1-eaba-4a3d-8d94-e6c30f927d4e, log id: 4e97891b >2012-08-06 13:45:30,517 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) [4f5c1b39] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 2842672f-6230-434f-8232-e88e71560092 >2012-08-06 13:45:30,518 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [4f5c1b39] EntityMultiAsyncTasks::AttachTask: Attaching task 3c119a02-073e-4da6-a1b2-b8b11c8b0b16 to entity 2842672f-6230-434f-8232-e88e71560092. >2012-08-06 13:45:30,519 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-50) [4f5c1b39] Adding task 3c119a02-073e-4da6-a1b2-b8b11c8b0b16 to DataBase >2012-08-06 13:45:30,563 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-50) [4f5c1b39] Adding task 3c119a02-073e-4da6-a1b2-b8b11c8b0b16 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 13:45:30,603 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-42) FINISH, UpdateVMVDSCommand, log id: c3df6a3 >2012-08-06 13:45:30,605 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-46) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=29ab0248-1ed3-464b-8280-ea0159164662), log id: 2c79ca83 >2012-08-06 13:45:30,679 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-46) FINISH, HSMClearTaskVDSCommand, log id: 2c79ca83 >2012-08-06 13:45:30,679 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-46) FINISH, SPMClearTaskVDSCommand, log id: 40dca3a8 >2012-08-06 13:45:30,728 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-46) BaseAsyncTask::RemoveTaskFromDB: Removed task 29ab0248-1ed3-464b-8280-ea0159164662 from DataBase >2012-08-06 13:45:30,728 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-46) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 >2012-08-06 13:45:30,738 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 13:45:30,739 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 13:45:30,755 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-44) START, SetVmStatusVDSCommand(vmId = 96405d4a-a3bd-4900-ab90-9c8736cb02a5, status = Down), log id: 545956a6 >2012-08-06 13:45:30,761 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-44) FINISH, SetVmStatusVDSCommand, log id: 545956a6 >2012-08-06 13:45:30,767 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-42) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 79a0d5a4-d091-4e5d-8168-17d09e22c688 >2012-08-06 13:45:30,768 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-42) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 79a0d5a4-d091-4e5d-8168-17d09e22c688), log id: 76b51de2 >2012-08-06 13:45:30,794 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-42) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=79a0d5a4-d091-4e5d-8168-17d09e22c688), log id: 7e3bc67c >2012-08-06 13:45:30,869 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-42) FINISH, HSMClearTaskVDSCommand, log id: 7e3bc67c >2012-08-06 13:45:30,870 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-42) FINISH, SPMClearTaskVDSCommand, log id: 76b51de2 >2012-08-06 13:45:30,909 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-42) BaseAsyncTask::RemoveTaskFromDB: Removed task 79a0d5a4-d091-4e5d-8168-17d09e22c688 from DataBase >2012-08-06 13:45:30,910 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 8738bb81-c73e-4a41-a24a-c4c49491c536 >2012-08-06 13:45:30,914 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-44) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 63e7552f >2012-08-06 13:45:31,007 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-44) FINISH, UpdateVMVDSCommand, log id: 63e7552f >2012-08-06 13:45:31,118 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-43) START, SetVmStatusVDSCommand(vmId = 6a729fb0-47fe-4eba-9ba3-2b939eee2b19, status = Down), log id: 24771d1 >2012-08-06 13:45:31,119 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 13:45:31,120 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 13:45:31,129 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-43) FINISH, SetVmStatusVDSCommand, log id: 24771d1 >2012-08-06 13:45:31,193 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 0e222300-c6ef-4a94-b3ce-893454fb1473 >2012-08-06 13:45:31,194 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 0e222300-c6ef-4a94-b3ce-893454fb1473), log id: 67dd7f05 >2012-08-06 13:45:31,210 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=0e222300-c6ef-4a94-b3ce-893454fb1473), log id: c775975 >2012-08-06 13:45:31,238 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-43) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 5f974f7f >2012-08-06 13:45:31,295 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) FINISH, HSMClearTaskVDSCommand, log id: c775975 >2012-08-06 13:45:31,295 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) FINISH, SPMClearTaskVDSCommand, log id: 67dd7f05 >2012-08-06 13:45:31,321 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) BaseAsyncTask::RemoveTaskFromDB: Removed task 0e222300-c6ef-4a94-b3ce-893454fb1473 from DataBase >2012-08-06 13:45:31,321 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 96405d4a-a3bd-4900-ab90-9c8736cb02a5 >2012-08-06 13:45:31,384 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-43) FINISH, UpdateVMVDSCommand, log id: 5f974f7f >2012-08-06 13:45:31,443 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-49) START, SetVmStatusVDSCommand(vmId = c7702cf0-88da-4885-9b9c-9e59772b3774, status = Down), log id: 7dfc7ddc >2012-08-06 13:45:31,443 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-43) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 13:45:31,446 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-43) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 13:45:31,452 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-49) FINISH, SetVmStatusVDSCommand, log id: 7dfc7ddc >2012-08-06 13:45:31,491 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-43) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 24e380c9-7f30-4487-b5a9-fe4f9d4a180a >2012-08-06 13:45:31,492 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-43) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 24e380c9-7f30-4487-b5a9-fe4f9d4a180a), log id: 26ab2fc6 >2012-08-06 13:45:31,507 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-43) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=24e380c9-7f30-4487-b5a9-fe4f9d4a180a), log id: 130d61e0 >2012-08-06 13:45:31,535 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-49) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 3c9562f >2012-08-06 13:45:31,588 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-43) FINISH, HSMClearTaskVDSCommand, log id: 130d61e0 >2012-08-06 13:45:31,588 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-43) FINISH, SPMClearTaskVDSCommand, log id: 26ab2fc6 >2012-08-06 13:45:31,604 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-43) BaseAsyncTask::RemoveTaskFromDB: Removed task 24e380c9-7f30-4487-b5a9-fe4f9d4a180a from DataBase >2012-08-06 13:45:31,605 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-43) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 >2012-08-06 13:45:31,737 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-49) FINISH, UpdateVMVDSCommand, log id: 3c9562f >2012-08-06 13:45:31,827 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 13:45:31,827 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 13:45:31,922 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-49) SPMAsyncTask::ClearAsyncTask: Attempting to clear task de13f018-9b9f-4f88-a340-66700b85c2f9 >2012-08-06 13:45:31,923 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-49) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = de13f018-9b9f-4f88-a340-66700b85c2f9), log id: 375a1c99 >2012-08-06 13:45:31,960 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-49) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=de13f018-9b9f-4f88-a340-66700b85c2f9), log id: 470ad7b6 >2012-08-06 13:45:32,072 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) [4f5c1b39] BaseAsyncTask::StartPollingTask: Starting to poll task 3c119a02-073e-4da6-a1b2-b8b11c8b0b16. >2012-08-06 13:45:32,073 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [4f5c1b39] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 2842672f-6230-434f-8232-e88e71560092 is AddVm (determined by task 3c119a02-073e-4da6-a1b2-b8b11c8b0b16) >2012-08-06 13:45:32,095 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-50) [7c50f0ac] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: cb2eea72-dfb3-11e1-89f8-5b30530ef35f Type: VmPool >2012-08-06 13:45:32,112 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-49) FINISH, HSMClearTaskVDSCommand, log id: 470ad7b6 >2012-08-06 13:45:32,112 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-49) FINISH, SPMClearTaskVDSCommand, log id: 375a1c99 >2012-08-06 13:45:32,185 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-49) BaseAsyncTask::RemoveTaskFromDB: Removed task de13f018-9b9f-4f88-a340-66700b85c2f9 from DataBase >2012-08-06 13:45:32,186 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity c7702cf0-88da-4885-9b9c-9e59772b3774 >2012-08-06 13:45:32,341 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [4f467ce] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 73e6bb8a >2012-08-06 13:45:32,343 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [4f467ce] FINISH, IsValidVDSCommand, return: true, log id: 73e6bb8a >2012-08-06 13:45:32,446 INFO [org.ovirt.engine.core.bll.AddVmAndAttachToPoolCommand] (pool-3-thread-50) [4f467ce] Running command: AddVmAndAttachToPoolCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:32,455 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [1e7baed5] Lock Acquired to object EngineLock [exclusiveLocks= key: pool1-15 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:32,496 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [1e7baed5] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 377ac0f9 >2012-08-06 13:45:32,498 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [1e7baed5] FINISH, IsValidVDSCommand, return: true, log id: 377ac0f9 >2012-08-06 13:45:32,499 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [1e7baed5] Running command: AddVmCommand internal: true. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups, ID: 574ff868-ed01-4038-93cc-f4fbfad23445 Type: VmTemplate, ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 13:45:32,501 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [1e7baed5] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 272334f4 >2012-08-06 13:45:32,502 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) [1e7baed5] FINISH, IsValidVDSCommand, return: true, log id: 272334f4 >2012-08-06 13:45:32,508 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [1e7baed5] MacPoolManager::allocateNewMac entered >2012-08-06 13:45:32,509 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [1e7baed5] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:70 >2012-08-06 13:45:32,535 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [1e7baed5] Lock freed to object EngineLock [exclusiveLocks= key: pool1-15 value: VM_NAME >, sharedLocks= ] >2012-08-06 13:45:32,535 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [1e7baed5] START, SetVmStatusVDSCommand(vmId = 5524b98a-aa45-49cb-9d8b-bec3884753c9, status = ImageLocked), log id: 6a344163 >2012-08-06 13:45:32,541 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) [1e7baed5] FINISH, SetVmStatusVDSCommand, log id: 6a344163 >2012-08-06 13:45:32,542 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-50) [586437a5] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: a9af3dac-1730-4ec8-8d7f-0507cee4aa1a Type: Storage >2012-08-06 13:45:32,544 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [586437a5] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f, imageId = bd6ab252-3a6a-4b62-adef-d865868df674), log id: 23ce0262 >2012-08-06 13:45:32,589 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [586437a5] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a851d2e4, log id: 23ce0262 >2012-08-06 13:45:32,591 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [586437a5] START, CreateSnapshotVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 007703e1-90f6-4059-b960-51e43b13bfc5, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 3e8e1dbb-6895-4aef-8889-c85ddfb5689f, newImageDescription = , imageId = bd6ab252-3a6a-4b62-adef-d865868df674, sourceImageGroupId = 0a10255f-3706-40e0-ac7d-26bbcba8d94f), log id: 6a744a31 >2012-08-06 13:45:32,593 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [586437a5] -- CreateSnapshotVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 13:45:32,594 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [586437a5] -- createVolume parameters: > sdUUID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a > spUUID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f > imgGUID=007703e1-90f6-4059-b960-51e43b13bfc5 > size=1,073,741,824 bytes > volFormat=COW > volType=Sparse > volUUID=3e8e1dbb-6895-4aef-8889-c85ddfb5689f > descr= > srcImgGUID=0a10255f-3706-40e0-ac7d-26bbcba8d94f > srcVolUUID=bd6ab252-3a6a-4b62-adef-d865868df674 > >2012-08-06 13:45:32,801 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-3-thread-50) [586437a5] FINISH, CreateSnapshotVDSCommand, return: 3e8e1dbb-6895-4aef-8889-c85ddfb5689f, log id: 6a744a31 >2012-08-06 13:45:32,819 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) [586437a5] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 5524b98a-aa45-49cb-9d8b-bec3884753c9 >2012-08-06 13:45:32,819 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [586437a5] EntityMultiAsyncTasks::AttachTask: Attaching task 773ca882-e80a-4a3a-bc58-312204f18f44 to entity 5524b98a-aa45-49cb-9d8b-bec3884753c9. >2012-08-06 13:45:32,821 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-50) [586437a5] Adding task 773ca882-e80a-4a3a-bc58-312204f18f44 to DataBase >2012-08-06 13:45:32,877 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-50) [586437a5] Adding task 773ca882-e80a-4a3a-bc58-312204f18f44 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 13:45:33,003 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) [586437a5] BaseAsyncTask::StartPollingTask: Starting to poll task 773ca882-e80a-4a3a-bc58-312204f18f44. >2012-08-06 13:45:33,004 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-50) [586437a5] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 5524b98a-aa45-49cb-9d8b-bec3884753c9 is AddVm (determined by task 773ca882-e80a-4a3a-bc58-312204f18f44) >2012-08-06 13:45:33,011 INFO [org.ovirt.engine.core.bll.AddVmToPoolCommand] (pool-3-thread-50) [436f30ee] Running command: AddVmToPoolCommand internal: true. Entities affected : ID: cb2eea72-dfb3-11e1-89f8-5b30530ef35f Type: VmPool >2012-08-06 13:45:38,469 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-100) Polling and updating Async Tasks: 15 tasks, 4 tasks to poll now >2012-08-06 13:45:38,515 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-100) SPMAsyncTask::PollTask: Polling task 773ca882-e80a-4a3a-bc58-312204f18f44 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 13:45:38,538 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-100) BaseAsyncTask::OnTaskEndSuccess: Task 773ca882-e80a-4a3a-bc58-312204f18f44 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 13:45:38,540 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-100) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 5524b98a-aa45-49cb-9d8b-bec3884753c9 has ended -> executing EndAction >2012-08-06 13:45:38,540 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-100) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 5524b98a-aa45-49cb-9d8b-bec3884753c9): calling EndAction for action type AddVm. >2012-08-06 13:45:38,541 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 13:45:38,550 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-100) SPMAsyncTask::PollTask: Polling task 5d4b44c3-1b94-4648-ac62-d474ca0390df (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 13:45:38,570 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-100) BaseAsyncTask::OnTaskEndSuccess: Task 5d4b44c3-1b94-4648-ac62-d474ca0390df (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 13:45:38,571 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-100) EntityAsyncTask::EndActionIfNecessary: All tasks of entity e5a192f1-3f9d-48e1-a817-28f72815c646 has ended -> executing EndAction >2012-08-06 13:45:38,571 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-100) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: e5a192f1-3f9d-48e1-a817-28f72815c646): calling EndAction for action type AddVm. >2012-08-06 13:45:38,572 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 13:45:38,577 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-100) SPMAsyncTask::PollTask: Polling task 3c119a02-073e-4da6-a1b2-b8b11c8b0b16 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 13:45:38,592 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-49) [1e7baed5] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 13:45:38,593 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-49) [586437a5] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 13:45:38,600 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-49) [586437a5] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 007703e1-90f6-4059-b960-51e43b13bfc5, imageId = 3e8e1dbb-6895-4aef-8889-c85ddfb5689f), log id: 290787c6 >2012-08-06 13:45:38,614 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-100) BaseAsyncTask::OnTaskEndSuccess: Task 3c119a02-073e-4da6-a1b2-b8b11c8b0b16 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 13:45:38,619 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-100) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 2842672f-6230-434f-8232-e88e71560092 has ended -> executing EndAction >2012-08-06 13:45:38,619 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-100) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 2842672f-6230-434f-8232-e88e71560092): calling EndAction for action type AddVm. >2012-08-06 13:45:38,620 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-43) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 13:45:38,625 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-100) SPMAsyncTask::PollTask: Polling task b1bdb85e-efd9-42ca-8f19-a5c97d45ae9c (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 13:45:38,631 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-50) [5093c6c7] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 13:45:38,632 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-50) [7b7ed051] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 13:45:38,643 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [7b7ed051] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = ece735c2-0ab3-4e87-80b3-18d4034c9b6f, imageId = 2bda6b70-f607-4757-bbbc-7f5df5875938), log id: 45cb7a10 >2012-08-06 13:45:38,656 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-100) BaseAsyncTask::OnTaskEndSuccess: Task b1bdb85e-efd9-42ca-8f19-a5c97d45ae9c (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 13:45:38,658 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-100) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 6c1fcddf-86d6-4533-905b-abb11b775f5b has ended -> executing EndAction >2012-08-06 13:45:38,658 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-100) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 6c1fcddf-86d6-4533-905b-abb11b775f5b): calling EndAction for action type AddVm. >2012-08-06 13:45:38,659 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddVm >2012-08-06 13:45:38,672 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-49) [586437a5] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@e6752f99, log id: 290787c6 >2012-08-06 13:45:38,696 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-49) START, SetVmStatusVDSCommand(vmId = 5524b98a-aa45-49cb-9d8b-bec3884753c9, status = Down), log id: 143f35fb >2012-08-06 13:45:38,705 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-43) [4db547ee] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 13:45:38,705 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-43) [4f5c1b39] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 13:45:38,716 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-49) FINISH, SetVmStatusVDSCommand, log id: 143f35fb >2012-08-06 13:45:38,719 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-43) [4f5c1b39] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = ff42535f-42bf-41e4-ba8a-978f426fdab9, imageId = a0f3dfa1-eaba-4a3d-8d94-e6c30f927d4e), log id: 6bdc70cd >2012-08-06 13:45:38,740 INFO [org.ovirt.engine.core.bll.AddVmCommand] (pool-3-thread-42) [3f234868] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand >2012-08-06 13:45:38,740 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (pool-3-thread-42) [1c17acc] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand >2012-08-06 13:45:38,743 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-42) [1c17acc] START, GetImageInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, imageGroupId = 1f44779b-3d85-488d-ab69-5ea6d9879ded, imageId = ca017c58-eab0-4eb4-9f60-ff9382cacae1), log id: 1f47d40d >2012-08-06 13:45:38,768 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [7b7ed051] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@2b91e0aa, log id: 45cb7a10 >2012-08-06 13:45:38,787 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-49) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 2a096c53 >2012-08-06 13:45:38,847 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-42) [1c17acc] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@21b62e65, log id: 1f47d40d >2012-08-06 13:45:38,900 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-43) [4f5c1b39] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@7d1f5088, log id: 6bdc70cd >2012-08-06 13:45:38,950 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-49) FINISH, UpdateVMVDSCommand, log id: 2a096c53 >2012-08-06 13:45:39,014 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) START, SetVmStatusVDSCommand(vmId = e5a192f1-3f9d-48e1-a817-28f72815c646, status = Down), log id: 49862041 >2012-08-06 13:45:39,026 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-50) FINISH, SetVmStatusVDSCommand, log id: 49862041 >2012-08-06 13:45:39,051 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 13:45:39,052 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 13:45:39,091 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-50) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 7f2ba4bb >2012-08-06 13:45:39,102 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-49) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 773ca882-e80a-4a3a-bc58-312204f18f44 >2012-08-06 13:45:39,103 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-49) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 773ca882-e80a-4a3a-bc58-312204f18f44), log id: 796c711f >2012-08-06 13:45:39,148 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-50) FINISH, UpdateVMVDSCommand, log id: 7f2ba4bb >2012-08-06 13:45:39,151 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-49) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=773ca882-e80a-4a3a-bc58-312204f18f44), log id: 5a5cff96 >2012-08-06 13:45:39,181 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-42) START, SetVmStatusVDSCommand(vmId = 6c1fcddf-86d6-4533-905b-abb11b775f5b, status = Down), log id: 3ddf7c10 >2012-08-06 13:45:39,184 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-42) FINISH, SetVmStatusVDSCommand, log id: 3ddf7c10 >2012-08-06 13:45:39,190 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-49) FINISH, HSMClearTaskVDSCommand, log id: 5a5cff96 >2012-08-06 13:45:39,191 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-49) FINISH, SPMClearTaskVDSCommand, log id: 796c711f >2012-08-06 13:45:39,199 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 13:45:39,200 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 13:45:39,231 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-49) BaseAsyncTask::RemoveTaskFromDB: Removed task 773ca882-e80a-4a3a-bc58-312204f18f44 from DataBase >2012-08-06 13:45:39,232 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 5524b98a-aa45-49cb-9d8b-bec3884753c9 >2012-08-06 13:45:39,253 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-42) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 62bc2e6a >2012-08-06 13:45:39,258 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 5d4b44c3-1b94-4648-ac62-d474ca0390df >2012-08-06 13:45:39,259 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-50) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 5d4b44c3-1b94-4648-ac62-d474ca0390df), log id: 74781e8 >2012-08-06 13:45:39,308 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-42) FINISH, UpdateVMVDSCommand, log id: 62bc2e6a >2012-08-06 13:45:39,311 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-50) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=5d4b44c3-1b94-4648-ac62-d474ca0390df), log id: 1851576 >2012-08-06 13:45:39,341 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 1851576 >2012-08-06 13:45:39,341 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 74781e8 >2012-08-06 13:45:39,371 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task 5d4b44c3-1b94-4648-ac62-d474ca0390df from DataBase >2012-08-06 13:45:39,371 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity e5a192f1-3f9d-48e1-a817-28f72815c646 >2012-08-06 13:45:39,373 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-43) START, SetVmStatusVDSCommand(vmId = 2842672f-6230-434f-8232-e88e71560092, status = Down), log id: 5b9f6de8 >2012-08-06 13:45:39,380 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-43) FINISH, SetVmStatusVDSCommand, log id: 5b9f6de8 >2012-08-06 13:45:39,401 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 13:45:39,401 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 13:45:39,437 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-43) START, UpdateVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 6ca17cf7 >2012-08-06 13:45:39,462 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-42) SPMAsyncTask::ClearAsyncTask: Attempting to clear task b1bdb85e-efd9-42ca-8f19-a5c97d45ae9c >2012-08-06 13:45:39,463 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-42) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = b1bdb85e-efd9-42ca-8f19-a5c97d45ae9c), log id: 774bc707 >2012-08-06 13:45:39,492 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-43) FINISH, UpdateVMVDSCommand, log id: 6ca17cf7 >2012-08-06 13:45:39,494 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-42) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=b1bdb85e-efd9-42ca-8f19-a5c97d45ae9c), log id: 42f86a76 >2012-08-06 13:45:39,533 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-42) FINISH, HSMClearTaskVDSCommand, log id: 42f86a76 >2012-08-06 13:45:39,534 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-42) FINISH, SPMClearTaskVDSCommand, log id: 774bc707 >2012-08-06 13:45:39,548 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-42) BaseAsyncTask::RemoveTaskFromDB: Removed task b1bdb85e-efd9-42ca-8f19-a5c97d45ae9c from DataBase >2012-08-06 13:45:39,549 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-42) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 6c1fcddf-86d6-4533-905b-abb11b775f5b >2012-08-06 13:45:39,559 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-43) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm completed, handling the result. >2012-08-06 13:45:39,559 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-43) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVm succeeded, clearing tasks. >2012-08-06 13:45:39,866 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-43) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 3c119a02-073e-4da6-a1b2-b8b11c8b0b16 >2012-08-06 13:45:39,867 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-43) START, SPMClearTaskVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 3c119a02-073e-4da6-a1b2-b8b11c8b0b16), log id: 44e03a4 >2012-08-06 13:45:39,871 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-43) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=3c119a02-073e-4da6-a1b2-b8b11c8b0b16), log id: 52d5cbef >2012-08-06 13:45:39,930 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-43) FINISH, HSMClearTaskVDSCommand, log id: 52d5cbef >2012-08-06 13:45:39,930 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-43) FINISH, SPMClearTaskVDSCommand, log id: 44e03a4 >2012-08-06 13:45:39,966 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-43) BaseAsyncTask::RemoveTaskFromDB: Removed task 3c119a02-073e-4da6-a1b2-b8b11c8b0b16 from DataBase >2012-08-06 13:45:39,966 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-43) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 2842672f-6230-434f-8232-e88e71560092 >2012-08-06 13:45:46,620 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/6/12 1:45 PM. Start running CanDoAction for command number 1/10 (Command type: RunVm) >2012-08-06 13:45:46,621 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/6/12 1:45 PM. Start running CanDoAction for command number 10/10 (Command type: RunVm) >2012-08-06 13:45:46,621 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/6/12 1:45 PM. Start running CanDoAction for command number 9/10 (Command type: RunVm) >2012-08-06 13:45:46,621 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) Start time: 8/6/12 1:45 PM. Start running CanDoAction for command number 8/10 (Command type: RunVm) >2012-08-06 13:45:46,621 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-41) Start time: 8/6/12 1:45 PM. Start running CanDoAction for command number 7/10 (Command type: RunVm) >2012-08-06 13:45:46,621 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/6/12 1:45 PM. Start running CanDoAction for command number 6/10 (Command type: RunVm) >2012-08-06 13:45:46,621 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) Start time: 8/6/12 1:45 PM. Start running CanDoAction for command number 5/10 (Command type: RunVm) >2012-08-06 13:45:46,620 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) Start time: 8/6/12 1:45 PM. Start running CanDoAction for command number 4/10 (Command type: RunVm) >2012-08-06 13:45:46,620 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/6/12 1:45 PM. Start running CanDoAction for command number 3/10 (Command type: RunVm) >2012-08-06 13:45:46,620 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) Start time: 8/6/12 1:45 PM. Start running CanDoAction for command number 2/10 (Command type: RunVm) >2012-08-06 13:45:46,685 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) Lock Acquired to object EngineLock [exclusiveLocks= key: d3c805a2-419c-480f-8627-f5c9ef5c4117 value: VM >, sharedLocks= ] >2012-08-06 13:45:46,690 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) Lock Acquired to object EngineLock [exclusiveLocks= key: 6c1fcddf-86d6-4533-905b-abb11b775f5b value: VM >, sharedLocks= ] >2012-08-06 13:45:46,696 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-47) Lock Acquired to object EngineLock [exclusiveLocks= key: c1cb365c-a119-493c-964c-faf65a10c889 value: VM >, sharedLocks= ] >2012-08-06 13:45:46,702 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) Lock Acquired to object EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-06 13:45:46,706 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) Lock Acquired to object EngineLock [exclusiveLocks= key: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 value: VM >, sharedLocks= ] >2012-08-06 13:45:46,710 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) Lock Acquired to object EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] >2012-08-06 13:45:46,720 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-44) Lock Acquired to object EngineLock [exclusiveLocks= key: 2842672f-6230-434f-8232-e88e71560092 value: VM >, sharedLocks= ] >2012-08-06 13:45:46,725 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) Lock Acquired to object EngineLock [exclusiveLocks= key: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 value: VM >, sharedLocks= ] >2012-08-06 13:45:46,730 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-43) Lock Acquired to object EngineLock [exclusiveLocks= key: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 value: VM >, sharedLocks= ] >2012-08-06 13:45:46,734 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) Lock Acquired to object EngineLock [exclusiveLocks= key: e5a192f1-3f9d-48e1-a817-28f72815c646 value: VM >, sharedLocks= ] >2012-08-06 13:45:46,793 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 7f2e2ac3 >2012-08-06 13:45:46,798 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) FINISH, IsValidVDSCommand, return: true, log id: 7f2e2ac3 >2012-08-06 13:45:46,803 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1d554bb4 >2012-08-06 13:45:46,805 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) FINISH, IsValidVDSCommand, return: true, log id: 1d554bb4 >2012-08-06 13:45:46,808 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-47) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 43dafd7d >2012-08-06 13:45:46,809 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-47) FINISH, IsValidVDSCommand, return: true, log id: 43dafd7d >2012-08-06 13:45:46,828 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 23794bee >2012-08-06 13:45:46,830 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) FINISH, IsValidVDSCommand, return: true, log id: 23794bee >2012-08-06 13:45:46,833 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-41) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 47c74eb2 >2012-08-06 13:45:46,834 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-41) FINISH, IsValidVDSCommand, return: true, log id: 47c74eb2 >2012-08-06 13:45:46,838 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 56ab97c3 >2012-08-06 13:45:46,839 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) FINISH, IsValidVDSCommand, return: true, log id: 56ab97c3 >2012-08-06 13:45:46,853 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4dbce33 >2012-08-06 13:45:46,855 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) FINISH, IsValidVDSCommand, return: true, log id: 4dbce33 >2012-08-06 13:45:46,956 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-41) START, IsVmDuringInitiatingVDSCommand(vmId = 6df57989-99a7-4ec9-8f7c-15f222064e61), log id: 74c97891 >2012-08-06 13:45:46,956 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-41) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 74c97891 >2012-08-06 13:45:47,120 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-41) End time: 8/6/12 1:45 PM. Finish handling CanDoAction for command number 7/10 (Command type: RunVm) >2012-08-06 13:45:47,139 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-44) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 66af81e5 >2012-08-06 13:45:47,141 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-44) FINISH, IsValidVDSCommand, return: true, log id: 66af81e5 >2012-08-06 13:45:47,144 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6a704ec1 >2012-08-06 13:45:47,145 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) FINISH, IsValidVDSCommand, return: true, log id: 6a704ec1 >2012-08-06 13:45:47,340 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-48) START, IsVmDuringInitiatingVDSCommand(vmId = d3c805a2-419c-480f-8627-f5c9ef5c4117), log id: 4cf7bbab >2012-08-06 13:45:47,350 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-48) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 4cf7bbab >2012-08-06 13:45:47,375 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-47) START, IsVmDuringInitiatingVDSCommand(vmId = c1cb365c-a119-493c-964c-faf65a10c889), log id: 2db10ab7 >2012-08-06 13:45:47,375 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-47) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 2db10ab7 >2012-08-06 13:45:47,402 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-43) START, IsVmDuringInitiatingVDSCommand(vmId = 6a729fb0-47fe-4eba-9ba3-2b939eee2b19), log id: 69e42f91 >2012-08-06 13:45:47,403 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-43) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 69e42f91 >2012-08-06 13:45:47,450 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) START, IsVmDuringInitiatingVDSCommand(vmId = a7d2a056-b67b-4bc5-b8ea-7afef2d2b861), log id: 606195db >2012-08-06 13:45:47,450 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 606195db >2012-08-06 13:45:47,479 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) End time: 8/6/12 1:45 PM. Finish handling CanDoAction for command number 8/10 (Command type: RunVm) >2012-08-06 13:45:47,494 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) START, IsVmDuringInitiatingVDSCommand(vmId = 6c1fcddf-86d6-4533-905b-abb11b775f5b), log id: 31d97fa8 >2012-08-06 13:45:47,495 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 31d97fa8 >2012-08-06 13:45:47,506 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/6/12 1:45 PM. Finish handling CanDoAction for command number 1/10 (Command type: RunVm) >2012-08-06 13:45:47,531 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/6/12 1:45 PM. Finish handling CanDoAction for command number 10/10 (Command type: RunVm) >2012-08-06 13:45:47,561 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-42) START, IsVmDuringInitiatingVDSCommand(vmId = 9dbe6b1e-2a98-449e-8bd7-2d025c420a42), log id: 25990622 >2012-08-06 13:45:47,561 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-42) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 25990622 >2012-08-06 13:45:47,567 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 72ad1e50 >2012-08-06 13:45:47,572 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/6/12 1:45 PM. Finish handling CanDoAction for command number 9/10 (Command type: RunVm) >2012-08-06 13:45:47,574 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-44) START, IsVmDuringInitiatingVDSCommand(vmId = 2842672f-6230-434f-8232-e88e71560092), log id: 30fb5e8f >2012-08-06 13:45:47,575 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-44) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 30fb5e8f >2012-08-06 13:45:47,591 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) FINISH, IsValidVDSCommand, return: true, log id: 72ad1e50 >2012-08-06 13:45:47,602 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) End time: 8/6/12 1:45 PM. Finish handling CanDoAction for command number 4/10 (Command type: RunVm) >2012-08-06 13:45:47,617 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) End time: 8/6/12 1:45 PM. Finish handling CanDoAction for command number 5/10 (Command type: RunVm) >2012-08-06 13:45:47,644 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) START, IsVmDuringInitiatingVDSCommand(vmId = 5524b98a-aa45-49cb-9d8b-bec3884753c9), log id: 1142c34b >2012-08-06 13:45:47,645 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 1142c34b >2012-08-06 13:45:47,677 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/6/12 1:45 PM. Finish handling CanDoAction for command number 6/10 (Command type: RunVm) >2012-08-06 13:45:47,729 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) End time: 8/6/12 1:45 PM. Finish handling CanDoAction for command number 2/10 (Command type: RunVm) >2012-08-06 13:45:47,823 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) START, IsVmDuringInitiatingVDSCommand(vmId = e5a192f1-3f9d-48e1-a817-28f72815c646), log id: 1f2bb29 >2012-08-06 13:45:47,823 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 1f2bb29 >2012-08-06 13:45:47,853 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/6/12 1:45 PM. Finish handling CanDoAction for command number 3/10 (Command type: RunVm) >2012-08-06 13:45:47,854 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) Start time: 8/6/12 1:45 PM. Start running CanDoAction for command number 12/15 (Command type: RunVm) >2012-08-06 13:45:47,855 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/6/12 1:45 PM. Start running CanDoAction for command number 13/15 (Command type: RunVm) >2012-08-06 13:45:47,856 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) Start time: 8/6/12 1:45 PM. Start running CanDoAction for command number 14/15 (Command type: RunVm) >2012-08-06 13:45:47,857 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) Start time: 8/6/12 1:45 PM. Start running CanDoAction for command number 15/15 (Command type: RunVm) >2012-08-06 13:45:47,862 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/6/12 1:45 PM. Start running CanDoAction for command number 11/15 (Command type: RunVm) >2012-08-06 13:45:47,873 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) Lock Acquired to object EngineLock [exclusiveLocks= key: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 value: VM >, sharedLocks= ] >2012-08-06 13:45:47,880 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) Lock Acquired to object EngineLock [exclusiveLocks= key: 3c7c0453-5f05-4314-bdd4-eb4fd243f80a value: VM >, sharedLocks= ] >2012-08-06 13:45:47,881 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-44) Lock Acquired to object EngineLock [exclusiveLocks= key: 8738bb81-c73e-4a41-a24a-c4c49491c536 value: VM >, sharedLocks= ] >2012-08-06 13:45:47,886 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) Lock Acquired to object EngineLock [exclusiveLocks= key: c7702cf0-88da-4885-9b9c-9e59772b3774 value: VM >, sharedLocks= ] >2012-08-06 13:45:47,898 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) Lock Acquired to object EngineLock [exclusiveLocks= key: 3ce0f220-6cb8-42d8-b922-7003c60ccdad value: VM >, sharedLocks= ] >2012-08-06 13:45:47,914 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 660b1e49 >2012-08-06 13:45:47,917 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-44) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 12f657ca >2012-08-06 13:45:47,919 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-44) FINISH, IsValidVDSCommand, return: true, log id: 12f657ca >2012-08-06 13:45:47,926 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 490800e6 >2012-08-06 13:45:47,928 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) FINISH, IsValidVDSCommand, return: true, log id: 490800e6 >2012-08-06 13:45:47,929 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 7b2de1ea >2012-08-06 13:45:47,930 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) FINISH, IsValidVDSCommand, return: true, log id: 7b2de1ea >2012-08-06 13:45:47,934 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) FINISH, IsValidVDSCommand, return: true, log id: 660b1e49 >2012-08-06 13:45:47,943 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6ce46ed4 >2012-08-06 13:45:47,945 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) FINISH, IsValidVDSCommand, return: true, log id: 6ce46ed4 >2012-08-06 13:45:48,006 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-44) START, IsVmDuringInitiatingVDSCommand(vmId = 8738bb81-c73e-4a41-a24a-c4c49491c536), log id: 60b1be14 >2012-08-06 13:45:48,006 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-44) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 60b1be14 >2012-08-06 13:45:48,015 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) End time: 8/6/12 1:45 PM. Finish handling CanDoAction for command number 14/15 (Command type: RunVm) >2012-08-06 13:45:48,022 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-42) START, IsVmDuringInitiatingVDSCommand(vmId = 3ce0f220-6cb8-42d8-b922-7003c60ccdad), log id: 6e4cb3ab >2012-08-06 13:45:48,023 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-42) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 6e4cb3ab >2012-08-06 13:45:48,023 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) START, IsVmDuringInitiatingVDSCommand(vmId = 96405d4a-a3bd-4900-ab90-9c8736cb02a5), log id: 265e1377 >2012-08-06 13:45:48,024 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 265e1377 >2012-08-06 13:45:48,026 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) START, IsVmDuringInitiatingVDSCommand(vmId = c7702cf0-88da-4885-9b9c-9e59772b3774), log id: 7f14ab04 >2012-08-06 13:45:48,027 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 7f14ab04 >2012-08-06 13:45:48,030 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) START, IsVmDuringInitiatingVDSCommand(vmId = 3c7c0453-5f05-4314-bdd4-eb4fd243f80a), log id: 6fb256b6 >2012-08-06 13:45:48,031 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 6fb256b6 >2012-08-06 13:45:48,045 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/6/12 1:45 PM. Finish handling CanDoAction for command number 11/15 (Command type: RunVm) >2012-08-06 13:45:48,046 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/6/12 1:45 PM. Finish handling CanDoAction for command number 13/15 (Command type: RunVm) >2012-08-06 13:45:48,047 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) End time: 8/6/12 1:45 PM. Finish handling CanDoAction for command number 12/15 (Command type: RunVm) >2012-08-06 13:45:48,050 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) End time: 8/6/12 1:45 PM. Finish handling CanDoAction for command number 15/15 (Command type: RunVm) >2012-08-06 13:45:48,205 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [c432501] Running command: RunVmCommand internal: false. Entities affected : ID: c1cb365c-a119-493c-964c-faf65a10c889 Type: VM >2012-08-06 13:45:48,248 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [c432501] START, CreateVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c1cb365c-a119-493c-964c-faf65a10c889, vm=org.ovirt.engine.core.common.businessentities.VM@52a1af6d), log id: 161d21fa >2012-08-06 13:45:48,255 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [c432501] START, CreateVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c1cb365c-a119-493c-964c-faf65a10c889, vm=org.ovirt.engine.core.common.businessentities.VM@52a1af6d), log id: 3b6faad0 >2012-08-06 13:45:48,320 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [c432501] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=c1cb365c-a119-493c-964c-faf65a10c889,devices=[Ljava.util.Map;@4ffcbdbd,acpiEnable=true,vmName=pool1-5,cpuType=Conroe,custom={} >2012-08-06 13:45:48,322 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [c432501] FINISH, CreateVDSCommand, log id: 3b6faad0 >2012-08-06 13:45:48,327 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [c432501] IncreasePendingVms::CreateVmIncreasing vds purple-vds3 pending vcpu count, now 1. Vm: pool1-5 >2012-08-06 13:45:48,400 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [c432501] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 161d21fa >2012-08-06 13:45:48,400 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [c432501] Lock freed to object EngineLock [exclusiveLocks= key: c1cb365c-a119-493c-964c-faf65a10c889 value: VM >, sharedLocks= ] >2012-08-06 13:45:48,574 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [73e04824] Running command: RunVmCommand internal: false. Entities affected : ID: c7702cf0-88da-4885-9b9c-9e59772b3774 Type: VM >2012-08-06 13:45:48,776 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [73e04824] START, CreateVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c7702cf0-88da-4885-9b9c-9e59772b3774, vm=org.ovirt.engine.core.common.businessentities.VM@2b966e0a), log id: 64e7c28f >2012-08-06 13:45:48,815 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [73e04824] START, CreateVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c7702cf0-88da-4885-9b9c-9e59772b3774, vm=org.ovirt.engine.core.common.businessentities.VM@2b966e0a), log id: 2bdb2635 >2012-08-06 13:45:48,901 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [73e04824] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=c7702cf0-88da-4885-9b9c-9e59772b3774,devices=[Ljava.util.Map;@53150030,acpiEnable=true,vmName=pool1-6,cpuType=Conroe,custom={} >2012-08-06 13:45:48,902 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [73e04824] FINISH, CreateVDSCommand, log id: 2bdb2635 >2012-08-06 13:45:48,915 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [73e04824] IncreasePendingVms::CreateVmIncreasing vds purple-vds3 pending vcpu count, now 2. Vm: pool1-6 >2012-08-06 13:45:48,960 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [73e04824] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 64e7c28f >2012-08-06 13:45:48,961 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [73e04824] Lock freed to object EngineLock [exclusiveLocks= key: c7702cf0-88da-4885-9b9c-9e59772b3774 value: VM >, sharedLocks= ] >2012-08-06 13:45:49,026 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [3af54127] Running command: RunVmCommand internal: false. Entities affected : ID: 3ce0f220-6cb8-42d8-b922-7003c60ccdad Type: VM >2012-08-06 13:45:49,063 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [3af54127] START, CreateVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad, vm=org.ovirt.engine.core.common.businessentities.VM@3b0b8e14), log id: 17451f53 >2012-08-06 13:45:49,066 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [3af54127] START, CreateVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad, vm=org.ovirt.engine.core.common.businessentities.VM@3b0b8e14), log id: 78b272e4 >2012-08-06 13:45:49,144 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [3af54127] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad,devices=[Ljava.util.Map;@668d9bdc,acpiEnable=true,vmName=pool1-7,cpuType=Conroe,custom={} >2012-08-06 13:45:49,145 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [3af54127] FINISH, CreateVDSCommand, log id: 78b272e4 >2012-08-06 13:45:49,152 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [3af54127] IncreasePendingVms::CreateVmIncreasing vds purple-vds3 pending vcpu count, now 3. Vm: pool1-7 >2012-08-06 13:45:49,182 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [3af54127] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 17451f53 >2012-08-06 13:45:49,182 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [3af54127] Lock freed to object EngineLock [exclusiveLocks= key: 3ce0f220-6cb8-42d8-b922-7003c60ccdad value: VM >, sharedLocks= ] >2012-08-06 13:45:49,263 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [1b40f294] Running command: RunVmCommand internal: false. Entities affected : ID: 3c7c0453-5f05-4314-bdd4-eb4fd243f80a Type: VM >2012-08-06 13:45:49,272 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [1b40f294] Cant find VDS to run the VM 3c7c0453-5f05-4314-bdd4-eb4fd243f80a on, so this VM will not be run. >2012-08-06 13:45:49,300 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [1b40f294] Lock freed to object EngineLock [exclusiveLocks= key: 3c7c0453-5f05-4314-bdd4-eb4fd243f80a value: VM >, sharedLocks= ] >2012-08-06 13:45:49,438 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [142f9270] Running command: RunVmCommand internal: false. Entities affected : ID: 6df57989-99a7-4ec9-8f7c-15f222064e61 Type: VM >2012-08-06 13:45:49,447 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [142f9270] Cant find VDS to run the VM 6df57989-99a7-4ec9-8f7c-15f222064e61 on, so this VM will not be run. >2012-08-06 13:45:49,482 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [142f9270] Lock freed to object EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-06 13:45:49,797 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [4336e375] Running command: RunVmCommand internal: false. Entities affected : ID: d3c805a2-419c-480f-8627-f5c9ef5c4117 Type: VM >2012-08-06 13:45:49,805 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [4336e375] Cant find VDS to run the VM d3c805a2-419c-480f-8627-f5c9ef5c4117 on, so this VM will not be run. >2012-08-06 13:45:49,833 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [4336e375] Lock freed to object EngineLock [exclusiveLocks= key: d3c805a2-419c-480f-8627-f5c9ef5c4117 value: VM >, sharedLocks= ] >2012-08-06 13:45:50,011 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [6bd7663d] Running command: RunVmCommand internal: false. Entities affected : ID: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 Type: VM >2012-08-06 13:45:50,025 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [6bd7663d] Cant find VDS to run the VM a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 on, so this VM will not be run. >2012-08-06 13:45:50,049 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [6bd7663d] Lock freed to object EngineLock [exclusiveLocks= key: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 value: VM >, sharedLocks= ] >2012-08-06 13:45:50,175 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [25e0c384] Running command: RunVmCommand internal: false. Entities affected : ID: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 Type: VM >2012-08-06 13:45:50,183 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [25e0c384] Cant find VDS to run the VM 96405d4a-a3bd-4900-ab90-9c8736cb02a5 on, so this VM will not be run. >2012-08-06 13:45:50,209 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [25e0c384] Lock freed to object EngineLock [exclusiveLocks= key: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 value: VM >, sharedLocks= ] >2012-08-06 13:45:50,323 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [27a05db9] Running command: RunVmCommand internal: false. Entities affected : ID: 8738bb81-c73e-4a41-a24a-c4c49491c536 Type: VM >2012-08-06 13:45:50,334 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [27a05db9] Cant find VDS to run the VM 8738bb81-c73e-4a41-a24a-c4c49491c536 on, so this VM will not be run. >2012-08-06 13:45:50,410 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [27a05db9] Lock freed to object EngineLock [exclusiveLocks= key: 8738bb81-c73e-4a41-a24a-c4c49491c536 value: VM >, sharedLocks= ] >2012-08-06 13:45:50,492 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [3ac1d527] Running command: RunVmCommand internal: false. Entities affected : ID: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 Type: VM >2012-08-06 13:45:50,505 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [3ac1d527] Cant find VDS to run the VM 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 on, so this VM will not be run. >2012-08-06 13:45:50,539 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [3ac1d527] Lock freed to object EngineLock [exclusiveLocks= key: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 value: VM >, sharedLocks= ] >2012-08-06 13:45:50,681 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [18893738] Running command: RunVmCommand internal: false. Entities affected : ID: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 Type: VM >2012-08-06 13:45:50,688 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [18893738] Cant find VDS to run the VM 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 on, so this VM will not be run. >2012-08-06 13:45:50,704 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [18893738] Lock freed to object EngineLock [exclusiveLocks= key: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 value: VM >, sharedLocks= ] >2012-08-06 13:45:50,860 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [4f17dd0] Running command: RunVmCommand internal: false. Entities affected : ID: e5a192f1-3f9d-48e1-a817-28f72815c646 Type: VM >2012-08-06 13:45:50,877 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [4f17dd0] Cant find VDS to run the VM e5a192f1-3f9d-48e1-a817-28f72815c646 on, so this VM will not be run. >2012-08-06 13:45:50,895 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [4f17dd0] Lock freed to object EngineLock [exclusiveLocks= key: e5a192f1-3f9d-48e1-a817-28f72815c646 value: VM >, sharedLocks= ] >2012-08-06 13:45:50,941 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-37) VM pool1-5 c1cb365c-a119-493c-964c-faf65a10c889 moved from WaitForLaunch --> PoweringUp >2012-08-06 13:45:50,942 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-37) START, FullListVdsCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=null, vmIds=[c7702cf0-88da-4885-9b9c-9e59772b3774, 3ce0f220-6cb8-42d8-b922-7003c60ccdad, c1cb365c-a119-493c-964c-faf65a10c889]), log id: 67bf49a4 >2012-08-06 13:45:50,991 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [45d22ed9] Running command: RunVmCommand internal: false. Entities affected : ID: 6c1fcddf-86d6-4533-905b-abb11b775f5b Type: VM >2012-08-06 13:45:51,008 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [45d22ed9] Cant find VDS to run the VM 6c1fcddf-86d6-4533-905b-abb11b775f5b on, so this VM will not be run. >2012-08-06 13:45:51,014 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-37) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@618e1a0c, log id: 67bf49a4 >2012-08-06 13:45:51,026 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [45d22ed9] Lock freed to object EngineLock [exclusiveLocks= key: 6c1fcddf-86d6-4533-905b-abb11b775f5b value: VM >, sharedLocks= ] >2012-08-06 13:45:51,039 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-37) Recieved a Device without an address when processing VM 3ce0f220-6cb8-42d8-b922-7003c60ccdad devices, skipping device: {specParams={}, device=ich6, type=sound, deviceId=c1973e6d-93b7-4c85-8fa7-5d5ed994c9bd}. >2012-08-06 13:45:51,040 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-37) Recieved a Device without an address when processing VM 3ce0f220-6cb8-42d8-b922-7003c60ccdad devices, skipping device: {specParams={vram=65536}, device=qxl, type=video, deviceId=db7f878b-acd0-4435-9302-9acfa67e54f9}. >2012-08-06 13:45:51,041 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-37) Recieved a Device without an address when processing VM 3ce0f220-6cb8-42d8-b922-7003c60ccdad devices, skipping device: {nicModel=pv, specParams={}, device=bridge, macAddr=00:1a:4a:23:61:5a, type=interface, deviceId=2e4ea804-94c3-4b67-abc0-68add6767411, network=rhevm}. >2012-08-06 13:45:51,044 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-37) Recieved a Device without an address when processing VM 3ce0f220-6cb8-42d8-b922-7003c60ccdad devices, skipping device: {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=7f3891bd-e3d8-41e9-98ca-1735b212a2b5}. >2012-08-06 13:45:51,045 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-37) Recieved a Device without an address when processing VM 3ce0f220-6cb8-42d8-b922-7003c60ccdad devices, skipping device: {shared=false, iface=ide, index=2, specParams={path=}, device=cdrom, path=, type=disk, readonly=true, deviceId=98118a01-ae27-44f1-9eda-58a4edf50a0e}. >2012-08-06 13:45:51,051 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-37) Recieved a Device without an address when processing VM 3ce0f220-6cb8-42d8-b922-7003c60ccdad devices, skipping device: {shared=false, volumeID=68bd3dcb-6d1e-42fe-8add-0bc6de67bf74, index=0, propagateErrors=off, format=cow, type=disk, truesize=139264, reqsize=0, bootOrder=1, iface=virtio, volumeChain=[Ljava.lang.Object;@1fbab073, imageID=a0383f76-762c-46fc-a85a-4a621481875f, domainID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, specParams={}, optional=false, needExtend=false, path=/rhev/data-center/efe20197-e0a7-49b8-beb4-19b1ed3f8c3f/a9af3dac-1730-4ec8-8d7f-0507cee4aa1a/images/a0383f76-762c-46fc-a85a-4a621481875f/68bd3dcb-6d1e-42fe-8add-0bc6de67bf74, device=disk, poolID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, readonly=false, apparentsize=262144, deviceId=a0383f76-762c-46fc-a85a-4a621481875f}. >2012-08-06 13:45:51,058 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-37) VM 3ce0f220-6cb8-42d8-b922-7003c60ccdad managed non plugable device was removed unexpetedly from libvirt: VmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad,DeviceId=db7f878b-acd0-4435-9302-9acfa67e54f9,Device=qxl,Type=video,BootOrder=0,SpecParams={vram=65536},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=false,alias= >2012-08-06 13:45:51,059 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-37) VM 3ce0f220-6cb8-42d8-b922-7003c60ccdad managed non plugable device was removed unexpetedly from libvirt: VmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad,DeviceId=7f3891bd-e3d8-41e9-98ca-1735b212a2b5,Device=memballoon,Type=balloon,BootOrder=0,SpecParams={model=virtio},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=true,alias= >2012-08-06 13:45:51,060 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-37) VM 3ce0f220-6cb8-42d8-b922-7003c60ccdad managed non plugable device was removed unexpetedly from libvirt: VmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad,DeviceId=2e4ea804-94c3-4b67-abc0-68add6767411,Device=bridge,Type=interface,BootOrder=0,SpecParams={},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=false,alias= >2012-08-06 13:45:51,068 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-37) VM 3ce0f220-6cb8-42d8-b922-7003c60ccdad managed non plugable device was removed unexpetedly from libvirt: VmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad,DeviceId=a0383f76-762c-46fc-a85a-4a621481875f,Device=disk,Type=disk,BootOrder=1,SpecParams={},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=false,alias= >2012-08-06 13:45:51,072 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-37) VM 3ce0f220-6cb8-42d8-b922-7003c60ccdad managed non plugable device was removed unexpetedly from libvirt: VmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad,DeviceId=98118a01-ae27-44f1-9eda-58a4edf50a0e,Device=cdrom,Type=disk,BootOrder=0,SpecParams={path=},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=true,alias= >2012-08-06 13:45:51,073 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-37) VM 3ce0f220-6cb8-42d8-b922-7003c60ccdad managed non plugable device was removed unexpetedly from libvirt: VmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad,DeviceId=c1973e6d-93b7-4c85-8fa7-5d5ed994c9bd,Device=ich6,Type=sound,BootOrder=0,SpecParams={},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=true,alias= >2012-08-06 13:45:51,168 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [6c3a5a77] Running command: RunVmCommand internal: false. Entities affected : ID: 2842672f-6230-434f-8232-e88e71560092 Type: VM >2012-08-06 13:45:51,222 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [6c3a5a77] Cant find VDS to run the VM 2842672f-6230-434f-8232-e88e71560092 on, so this VM will not be run. >2012-08-06 13:45:51,283 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [6c3a5a77] Lock freed to object EngineLock [exclusiveLocks= key: 2842672f-6230-434f-8232-e88e71560092 value: VM >, sharedLocks= ] >2012-08-06 13:45:51,552 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [215c004d] Running command: RunVmCommand internal: false. Entities affected : ID: 5524b98a-aa45-49cb-9d8b-bec3884753c9 Type: VM >2012-08-06 13:45:51,591 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [215c004d] Cant find VDS to run the VM 5524b98a-aa45-49cb-9d8b-bec3884753c9 on, so this VM will not be run. >2012-08-06 13:45:51,625 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [215c004d] Lock freed to object EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] >2012-08-06 13:45:53,524 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-40) VM pool1-6 c7702cf0-88da-4885-9b9c-9e59772b3774 moved from WaitForLaunch --> PoweringUp >2012-08-06 13:45:53,526 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-40) VM pool1-7 3ce0f220-6cb8-42d8-b922-7003c60ccdad moved from WaitForLaunch --> PoweringUp >2012-08-06 13:45:53,532 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-40) START, FullListVdsCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=null, vmIds=[3ce0f220-6cb8-42d8-b922-7003c60ccdad]), log id: 50980be3 >2012-08-06 13:45:53,565 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-40) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@7c30837f, log id: 50980be3 >2012-08-06 13:46:27,567 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-88) Setting new tasks map. The map contains now 11 tasks >2012-08-06 13:46:47,038 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-18) DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 13:46:49,969 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-42) VM pool1-6 c7702cf0-88da-4885-9b9c-9e59772b3774 moved from PoweringUp --> Up >2012-08-06 13:46:49,970 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-42) VM pool1-7 3ce0f220-6cb8-42d8-b922-7003c60ccdad moved from PoweringUp --> Up >2012-08-06 13:46:49,970 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-42) VM pool1-5 c1cb365c-a119-493c-964c-faf65a10c889 moved from PoweringUp --> Up >2012-08-06 13:46:49,991 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-42) START, UpdateVdsDynamicDataVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@1b666a67), log id: 5b952fc0 >2012-08-06 13:46:50,018 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-42) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 5b952fc0 >2012-08-06 13:46:50,058 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-42) START, UpdateVdsDynamicDataVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@83000a88), log id: 3400ce42 >2012-08-06 13:46:50,083 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-42) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 3400ce42 >2012-08-06 13:46:50,179 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-42) START, UpdateVdsDynamicDataVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@ea99aaa9), log id: 4f949995 >2012-08-06 13:46:50,194 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-42) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 4f949995 >2012-08-06 13:46:57,567 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-51) Setting new tasks map. The map contains now 0 tasks >2012-08-06 13:46:57,568 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-51) Cleared all tasks of pool efe20197-e0a7-49b8-beb4-19b1ed3f8c3f. >2012-08-06 13:46:57,571 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-51) Could not find vds that is spm and non-operational. >2012-08-06 13:47:13,729 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) Start time: 8/6/12 1:47 PM. Start running CanDoAction for command number 1/4 (Command type: RunVm) >2012-08-06 13:47:13,730 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/6/12 1:47 PM. Start running CanDoAction for command number 2/4 (Command type: RunVm) >2012-08-06 13:47:13,730 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) Start time: 8/6/12 1:47 PM. Start running CanDoAction for command number 3/4 (Command type: RunVm) >2012-08-06 13:47:13,731 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/6/12 1:47 PM. Start running CanDoAction for command number 4/4 (Command type: RunVm) >2012-08-06 13:47:13,743 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) Lock Acquired to object EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-06 13:47:13,745 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) Lock Acquired to object EngineLock [exclusiveLocks= key: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 value: VM >, sharedLocks= ] >2012-08-06 13:47:13,748 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) Lock Acquired to object EngineLock [exclusiveLocks= key: d3c805a2-419c-480f-8627-f5c9ef5c4117 value: VM >, sharedLocks= ] >2012-08-06 13:47:13,762 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) Lock Acquired to object EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] >2012-08-06 13:47:13,784 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 333c6180 >2012-08-06 13:47:13,786 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) FINISH, IsValidVDSCommand, return: true, log id: 333c6180 >2012-08-06 13:47:13,794 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 931d3b >2012-08-06 13:47:13,798 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) FINISH, IsValidVDSCommand, return: true, log id: 931d3b >2012-08-06 13:47:13,851 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 64245af4 >2012-08-06 13:47:13,854 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) FINISH, IsValidVDSCommand, return: true, log id: 64245af4 >2012-08-06 13:47:13,862 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 3e4549e5 >2012-08-06 13:47:13,867 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) FINISH, IsValidVDSCommand, return: true, log id: 3e4549e5 >2012-08-06 13:47:13,888 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) START, IsVmDuringInitiatingVDSCommand(vmId = 6df57989-99a7-4ec9-8f7c-15f222064e61), log id: 4bda52e1 >2012-08-06 13:47:13,889 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 4bda52e1 >2012-08-06 13:47:13,896 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/6/12 1:47 PM. Finish handling CanDoAction for command number 2/4 (Command type: RunVm) >2012-08-06 13:47:13,925 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-42) START, IsVmDuringInitiatingVDSCommand(vmId = 5524b98a-aa45-49cb-9d8b-bec3884753c9), log id: 392efabc >2012-08-06 13:47:13,926 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-42) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 392efabc >2012-08-06 13:47:13,932 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) End time: 8/6/12 1:47 PM. Finish handling CanDoAction for command number 1/4 (Command type: RunVm) >2012-08-06 13:47:14,031 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) START, IsVmDuringInitiatingVDSCommand(vmId = a7d2a056-b67b-4bc5-b8ea-7afef2d2b861), log id: 3ae39db1 >2012-08-06 13:47:14,032 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 3ae39db1 >2012-08-06 13:47:14,042 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/6/12 1:47 PM. Finish handling CanDoAction for command number 4/4 (Command type: RunVm) >2012-08-06 13:47:14,055 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) START, IsVmDuringInitiatingVDSCommand(vmId = d3c805a2-419c-480f-8627-f5c9ef5c4117), log id: 74f0519a >2012-08-06 13:47:14,056 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 74f0519a >2012-08-06 13:47:14,063 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) End time: 8/6/12 1:47 PM. Finish handling CanDoAction for command number 3/4 (Command type: RunVm) >2012-08-06 13:47:14,125 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) [33d0eb8b] Running command: RunVmCommand internal: false. Entities affected : ID: 6df57989-99a7-4ec9-8f7c-15f222064e61 Type: VM >2012-08-06 13:47:14,160 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-50) [33d0eb8b] START, CreateVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=6df57989-99a7-4ec9-8f7c-15f222064e61, vm=org.ovirt.engine.core.common.businessentities.VM@6c334a22), log id: 770ae4cc >2012-08-06 13:47:14,166 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-50) [33d0eb8b] START, CreateVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=6df57989-99a7-4ec9-8f7c-15f222064e61, vm=org.ovirt.engine.core.common.businessentities.VM@6c334a22), log id: 3ce2f05f >2012-08-06 13:47:14,233 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-50) [33d0eb8b] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=6df57989-99a7-4ec9-8f7c-15f222064e61,devices=[Ljava.util.Map;@23af1ed5,acpiEnable=true,vmName=pool1-2,cpuType=Conroe,custom={} >2012-08-06 13:47:14,235 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-50) [33d0eb8b] FINISH, CreateVDSCommand, log id: 3ce2f05f >2012-08-06 13:47:14,240 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-50) [33d0eb8b] IncreasePendingVms::CreateVmIncreasing vds purple-vds3 pending vcpu count, now 1. Vm: pool1-2 >2012-08-06 13:47:14,279 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-50) [33d0eb8b] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 770ae4cc >2012-08-06 13:47:14,279 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) [33d0eb8b] Lock freed to object EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-06 13:47:14,400 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) [bffa536] Running command: RunVmCommand internal: false. Entities affected : ID: d3c805a2-419c-480f-8627-f5c9ef5c4117 Type: VM >2012-08-06 13:47:14,447 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-50) [bffa536] START, CreateVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=d3c805a2-419c-480f-8627-f5c9ef5c4117, vm=org.ovirt.engine.core.common.businessentities.VM@68b5b94f), log id: 778d77d2 >2012-08-06 13:47:14,460 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-50) [bffa536] START, CreateVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=d3c805a2-419c-480f-8627-f5c9ef5c4117, vm=org.ovirt.engine.core.common.businessentities.VM@68b5b94f), log id: 27091765 >2012-08-06 13:47:14,543 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-50) [bffa536] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=d3c805a2-419c-480f-8627-f5c9ef5c4117,devices=[Ljava.util.Map;@1ea99673,acpiEnable=true,vmName=pool1-3,cpuType=Conroe,custom={} >2012-08-06 13:47:14,545 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-50) [bffa536] FINISH, CreateVDSCommand, log id: 27091765 >2012-08-06 13:47:14,550 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-50) [bffa536] IncreasePendingVms::CreateVmIncreasing vds purple-vds3 pending vcpu count, now 2. Vm: pool1-3 >2012-08-06 13:47:14,921 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-50) [bffa536] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 778d77d2 >2012-08-06 13:47:14,922 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) [bffa536] Lock freed to object EngineLock [exclusiveLocks= key: d3c805a2-419c-480f-8627-f5c9ef5c4117 value: VM >, sharedLocks= ] >2012-08-06 13:47:15,063 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) [164894c9] Running command: RunVmCommand internal: false. Entities affected : ID: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 Type: VM >2012-08-06 13:47:15,071 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) [164894c9] Cant find VDS to run the VM a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 on, so this VM will not be run. >2012-08-06 13:47:15,090 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) [164894c9] Lock freed to object EngineLock [exclusiveLocks= key: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 value: VM >, sharedLocks= ] >2012-08-06 13:47:15,181 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) [6eac7f20] Running command: RunVmCommand internal: false. Entities affected : ID: 5524b98a-aa45-49cb-9d8b-bec3884753c9 Type: VM >2012-08-06 13:47:15,188 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) [6eac7f20] Cant find VDS to run the VM 5524b98a-aa45-49cb-9d8b-bec3884753c9 on, so this VM will not be run. >2012-08-06 13:47:15,205 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) [6eac7f20] Lock freed to object EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] >2012-08-06 13:47:17,047 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-84) VM pool1-3 d3c805a2-419c-480f-8627-f5c9ef5c4117 moved from WaitForLaunch --> PoweringUp >2012-08-06 13:47:17,054 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-84) VM pool1-2 6df57989-99a7-4ec9-8f7c-15f222064e61 moved from WaitForLaunch --> PoweringUp >2012-08-06 13:47:17,056 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-84) START, FullListVdsCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=null, vmIds=[d3c805a2-419c-480f-8627-f5c9ef5c4117, 6df57989-99a7-4ec9-8f7c-15f222064e61]), log id: 71bb2ced >2012-08-06 13:47:17,088 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-84) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@3782b5f0, log id: 71bb2ced >2012-08-06 13:48:14,871 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-94) VM pool1-3 d3c805a2-419c-480f-8627-f5c9ef5c4117 moved from PoweringUp --> Up >2012-08-06 13:48:14,871 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-94) VM pool1-2 6df57989-99a7-4ec9-8f7c-15f222064e61 moved from PoweringUp --> Up >2012-08-06 13:48:14,920 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-94) START, UpdateVdsDynamicDataVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@4216c430), log id: 6a69d69c >2012-08-06 13:48:14,947 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-94) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 6a69d69c >2012-08-06 13:48:15,024 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-94) START, UpdateVdsDynamicDataVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@a9b06451), log id: 27c00b10 >2012-08-06 13:48:15,066 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-94) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 27c00b10 >2012-08-06 13:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable hosts >2012-08-06 13:50:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Autorecovering 0 hosts >2012-08-06 13:50:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable hosts done >2012-08-06 13:50:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable storage domains >2012-08-06 13:50:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Autorecovering 0 storage domains >2012-08-06 13:50:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable storage domains done >2012-08-06 13:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts >2012-08-06 13:55:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering 0 hosts >2012-08-06 13:55:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts done >2012-08-06 13:55:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable storage domains >2012-08-06 13:55:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering 0 storage domains >2012-08-06 13:55:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable storage domains done >2012-08-06 14:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable hosts >2012-08-06 14:00:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Autorecovering 0 hosts >2012-08-06 14:00:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable hosts done >2012-08-06 14:00:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable storage domains >2012-08-06 14:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Autorecovering 0 storage domains >2012-08-06 14:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable storage domains done >2012-08-06 14:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Checking autorecoverable hosts >2012-08-06 14:05:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Autorecovering 0 hosts >2012-08-06 14:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Checking autorecoverable hosts done >2012-08-06 14:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Checking autorecoverable storage domains >2012-08-06 14:05:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Autorecovering 0 storage domains >2012-08-06 14:05:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Checking autorecoverable storage domains done >2012-08-06 14:05:04,936 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-9) START, GetDeviceListVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storageType=ISCSI), log id: 71f33155 >2012-08-06 14:05:07,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-9) FINISH, GetDeviceListVDSCommand, return: [], log id: 71f33155 >2012-08-06 14:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) Checking autorecoverable hosts >2012-08-06 14:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) Autorecovering 0 hosts >2012-08-06 14:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) Checking autorecoverable hosts done >2012-08-06 14:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) Checking autorecoverable storage domains >2012-08-06 14:10:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) Autorecovering 0 storage domains >2012-08-06 14:10:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) Checking autorecoverable storage domains done >2012-08-06 14:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Checking autorecoverable hosts >2012-08-06 14:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Autorecovering 0 hosts >2012-08-06 14:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Checking autorecoverable hosts done >2012-08-06 14:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Checking autorecoverable storage domains >2012-08-06 14:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Autorecovering 0 storage domains >2012-08-06 14:15:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Checking autorecoverable storage domains done >2012-08-06 14:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable hosts >2012-08-06 14:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Autorecovering 0 hosts >2012-08-06 14:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable hosts done >2012-08-06 14:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable storage domains >2012-08-06 14:20:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Autorecovering 0 storage domains >2012-08-06 14:20:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable storage domains done >2012-08-06 14:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable hosts >2012-08-06 14:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Autorecovering 0 hosts >2012-08-06 14:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable hosts done >2012-08-06 14:25:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable storage domains >2012-08-06 14:25:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Autorecovering 0 storage domains >2012-08-06 14:25:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable storage domains done >2012-08-06 14:27:05,089 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8009-5) Lock Acquired to object EngineLock [exclusiveLocks= key: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 value: VM >, sharedLocks= ] >2012-08-06 14:27:05,099 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-5) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 5d188a21 >2012-08-06 14:27:05,108 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-5) FINISH, IsValidVDSCommand, return: true, log id: 5d188a21 >2012-08-06 14:27:05,209 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-5) START, IsVmDuringInitiatingVDSCommand(vmId = a7d2a056-b67b-4bc5-b8ea-7afef2d2b861), log id: db22aea >2012-08-06 14:27:05,210 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-5) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: db22aea >2012-08-06 14:27:05,377 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) [2dc38cf] Running command: RunVmCommand internal: false. Entities affected : ID: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 Type: VM >2012-08-06 14:27:05,428 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-49) [2dc38cf] START, CreateVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861, vm=org.ovirt.engine.core.common.businessentities.VM@22ca8186), log id: 5f5a5232 >2012-08-06 14:27:05,433 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-49) [2dc38cf] START, CreateVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861, vm=org.ovirt.engine.core.common.businessentities.VM@22ca8186), log id: 54be65a >2012-08-06 14:27:05,520 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-49) [2dc38cf] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861,devices=[Ljava.util.Map;@46efb95a,acpiEnable=true,vmName=pool1-4,cpuType=Conroe,custom={} >2012-08-06 14:27:05,523 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-49) [2dc38cf] FINISH, CreateVDSCommand, log id: 54be65a >2012-08-06 14:27:05,534 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-49) [2dc38cf] IncreasePendingVms::CreateVmIncreasing vds purple-vds3 pending vcpu count, now 1. Vm: pool1-4 >2012-08-06 14:27:05,575 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-49) [2dc38cf] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 5f5a5232 >2012-08-06 14:27:05,576 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) [2dc38cf] Lock freed to object EngineLock [exclusiveLocks= key: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 value: VM >, sharedLocks= ] >2012-08-06 14:27:06,901 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-51) VM pool1-4 a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 moved from WaitForLaunch --> PoweringUp >2012-08-06 14:27:06,902 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-51) START, FullListVdsCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=null, vmIds=[a7d2a056-b67b-4bc5-b8ea-7afef2d2b861]), log id: 57227e40 >2012-08-06 14:27:06,925 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-51) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@198ec871, log id: 57227e40 >2012-08-06 14:28:06,189 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-44) VM pool1-4 a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 moved from PoweringUp --> Up >2012-08-06 14:28:06,208 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-44) START, UpdateVdsDynamicDataVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@58987669), log id: 2c0f93f >2012-08-06 14:28:06,226 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-44) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 2c0f93f >2012-08-06 14:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Checking autorecoverable hosts >2012-08-06 14:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Autorecovering 0 hosts >2012-08-06 14:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Checking autorecoverable hosts done >2012-08-06 14:30:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Checking autorecoverable storage domains >2012-08-06 14:30:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Autorecovering 0 storage domains >2012-08-06 14:30:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Checking autorecoverable storage domains done >2012-08-06 14:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Checking autorecoverable hosts >2012-08-06 14:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Autorecovering 0 hosts >2012-08-06 14:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Checking autorecoverable hosts done >2012-08-06 14:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Checking autorecoverable storage domains >2012-08-06 14:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Autorecovering 0 storage domains >2012-08-06 14:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Checking autorecoverable storage domains done >2012-08-06 14:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable hosts >2012-08-06 14:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Autorecovering 0 hosts >2012-08-06 14:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable hosts done >2012-08-06 14:40:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable storage domains >2012-08-06 14:40:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Autorecovering 0 storage domains >2012-08-06 14:40:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable storage domains done >2012-08-06 14:43:05,924 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) Start time: 8/6/12 2:43 PM >2012-08-06 14:43:06,074 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: CbcCheckOnVdsChange >2012-08-06 14:43:06,095 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: CAEngineKey >2012-08-06 14:43:06,095 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: ENGINEEARLib >2012-08-06 14:43:06,122 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: MinimalETLVersion >2012-08-06 14:43:06,445 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: ScriptsPath >2012-08-06 14:43:06,446 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: SQLServerI18NPrefix >2012-08-06 14:43:06,558 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (MSC service thread 1-2) Failed to decrypt Data must start with zero >2012-08-06 14:43:06,564 ERROR [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (MSC service thread 1-2) Failed to decrypt value for property TruststorePass will be used encrypted value >2012-08-06 14:43:06,656 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) VDSBrokerFrontend: 8/6/12 2:43 PM >2012-08-06 14:43:06,668 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) CpuFlagsManager: 8/6/12 2:43 PM >2012-08-06 14:43:06,671 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-2) Setting audit clean up manager to run at: 35 35 3 * * ? >2012-08-06 14:43:06,721 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) AuditLogCleanupManager: 8/6/12 2:43 PM >2012-08-06 14:43:06,725 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-2) TagsDirector initialization >2012-08-06 14:43:06,764 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-2) Tag root added to tree >2012-08-06 14:43:06,791 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) TagsDirector: 8/6/12 2:43 PM >2012-08-06 14:43:06,806 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) IsoDomainListSyncronizer: 8/6/12 2:43 PM >2012-08-06 14:43:06,848 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) InitHandlers: 8/6/12 2:43 PM >2012-08-06 14:43:06,871 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-2) Code VDS_FENCING_OPERATION_FAILED appears more then once in string table. >2012-08-06 14:43:06,876 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) ErrorTranslator: 8/6/12 2:43 PM >2012-08-06 14:43:06,877 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) VdsErrorTranslator: 8/6/12 2:43 PM >2012-08-06 14:43:06,879 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) Mark uncompleted jobs as UNKNOWN: 8/6/12 2:43 PM >2012-08-06 14:43:06,954 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) JobRepositoryCleanupManager: 8/6/12 2:43 PM >2012-08-06 14:43:06,960 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) AutoRecoveryManager: 8/6/12 2:43 PM >2012-08-06 14:43:06,964 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) ExecutionMessageDirector: 8/6/12 2:43 PM >2012-08-06 14:43:06,997 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-1) InitResourceManager: 8/6/12 2:43 PM >2012-08-06 14:43:06,998 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (MSC service thread 1-2) UsersDomainsCacheManager: 8/6/12 2:43 PM >2012-08-06 14:43:07,008 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-1) ResourceManager::ResourceManager::Entered >2012-08-06 14:43:07,097 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (MSC service thread 1-2) DbUserCacheManager: 8/6/12 2:43 PM >2012-08-06 14:43:07,150 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-1) DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 14:43:12,459 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) Eneterd VdsManager:constructor >2012-08-06 14:43:12,463 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) vdsBroker(purple-vds2,54,321) >2012-08-06 14:43:12,658 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-1) ResourceManager::AddVds - VDS 4196a566-dee6-11e1-b66e-c35c5273fee7 was added to the Resource Manager >2012-08-06 14:43:14,684 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-2) Initializing Host: purple-vds2 >2012-08-06 14:43:17,661 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) Eneterd VdsManager:constructor >2012-08-06 14:43:17,663 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) vdsBroker(purple-vds3,54,321) >2012-08-06 14:43:17,672 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-1) ResourceManager::AddVds - VDS 47028088-dee6-11e1-bffa-2f8f15de3134 was added to the Resource Manager >2012-08-06 14:43:17,724 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (MSC service thread 1-1) AsyncTaskManager: Initialization of AsyncTaskManager completed successfully. >2012-08-06 14:43:17,725 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-1) AsyncTaskManager: 8/6/12 2:43 PM >2012-08-06 14:43:17,727 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-1) VdsLoadBalancer: 8/6/12 2:43 PM >2012-08-06 14:43:17,737 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (pool-3-thread-1) MacPoolManager started: 8/6/12 2:43 PM >2012-08-06 14:43:17,999 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (pool-3-thread-1) MacPoolManager finished: 8/6/12 2:43 PM >2012-08-06 14:43:20,590 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-5) AuditLogType: UNASSIGNED not exist in string table >2012-08-06 14:43:20,596 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-5) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table >2012-08-06 14:43:20,597 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-5) AuditLogType: DWH_STOPPED not exist in string table >2012-08-06 14:43:20,598 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-5) AuditLogType: DWH_STARTED not exist in string table >2012-08-06 14:43:20,601 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-5) AuditLogType: DWH_ERROR not exist in string table >2012-08-06 14:43:20,609 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-5) AuditLogType: USER_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2012-08-06 14:43:20,610 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-5) AuditLogType: USER_FAILED_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2012-08-06 14:43:20,611 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-5) AuditLogType: USER_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2012-08-06 14:43:20,612 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-5) AuditLogType: USER_FAILED_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2012-08-06 14:43:21,289 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-5) Initializing Host: purple-vds3 >2012-08-06 14:43:21,509 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-5) [597ec698] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 14:43:27,894 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-18) [6a0b4f90] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-06 14:43:28,116 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-18) [6a0b4f90] hostFromVds::selectedVds - purple-vds3, spmStatus SPM, storage pool nfs31 >2012-08-06 14:43:28,133 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-18) [6a0b4f90] Initialize Irs proxy from vds: purple-vds3 >2012-08-06 14:43:28,459 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-20) START, SPMGetAllTasksInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 44ef4087 >2012-08-06 14:43:28,538 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-20) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool efe20197-e0a7-49b8-beb4-19b1ed3f8c3f >2012-08-06 14:43:28,567 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-20) START, HSMGetAllTasksInfoVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134), log id: 70c56c6d >2012-08-06 14:43:28,613 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-20) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 70c56c6d >2012-08-06 14:43:28,613 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-20) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 44ef4087 >2012-08-06 14:43:28,614 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-20) Discovered no tasks on Storage Pool nfs31 >2012-08-06 14:43:56,540 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp--127.0.0.1-8009-2) [10b709b4] Running command: LogoutUserCommand internal: false. >2012-08-06 14:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable hosts >2012-08-06 14:45:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Autorecovering 0 hosts >2012-08-06 14:45:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable hosts done >2012-08-06 14:45:00,025 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable storage domains >2012-08-06 14:45:00,041 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Autorecovering 0 storage domains >2012-08-06 14:45:00,042 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable storage domains done >2012-08-06 14:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable hosts >2012-08-06 14:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Autorecovering 0 hosts >2012-08-06 14:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable hosts done >2012-08-06 14:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable storage domains >2012-08-06 14:50:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Autorecovering 0 storage domains >2012-08-06 14:50:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable storage domains done >2012-08-06 14:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) Checking autorecoverable hosts >2012-08-06 14:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) Autorecovering 0 hosts >2012-08-06 14:55:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) Checking autorecoverable hosts done >2012-08-06 14:55:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) Checking autorecoverable storage domains >2012-08-06 14:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) Autorecovering 0 storage domains >2012-08-06 14:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) Checking autorecoverable storage domains done >2012-08-06 15:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Checking autorecoverable hosts >2012-08-06 15:00:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Autorecovering 0 hosts >2012-08-06 15:00:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Checking autorecoverable hosts done >2012-08-06 15:00:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Checking autorecoverable storage domains >2012-08-06 15:00:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Autorecovering 0 storage domains >2012-08-06 15:00:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Checking autorecoverable storage domains done >2012-08-06 15:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) Checking autorecoverable hosts >2012-08-06 15:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) Autorecovering 0 hosts >2012-08-06 15:05:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) Checking autorecoverable hosts done >2012-08-06 15:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) Checking autorecoverable storage domains >2012-08-06 15:05:00,047 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) Autorecovering 0 storage domains >2012-08-06 15:05:00,049 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) Checking autorecoverable storage domains done >2012-08-06 15:08:59,338 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-8) Checking if user admin@internal is an admin, result true >2012-08-06 15:08:59,343 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-8) Running command: LoginAdminUserCommand internal: false. >2012-08-06 15:09:03,396 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-11) Adding new value to configuration cache. >2012-08-06 15:09:03,409 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-11) Didnt find the value of DBPagingType in DB for version general - using default: Offset >2012-08-06 15:09:03,411 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-11) Adding new value to configuration cache. >2012-08-06 15:09:03,416 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-11) Didnt find the value of DBPagingSyntax in DB for version general - using default: OFFSET (%1$s -1) LIMIT %2$s >2012-08-06 15:09:03,422 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-11) Adding new value to configuration cache. >2012-08-06 15:09:03,426 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-11) Didnt find the value of DBSearchTemplate in DB for version general - using default: SELECT * FROM (%2$s) %1$s) as T1 %3$s >2012-08-06 15:09:12,473 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/6/12 3:09 PM. Start running CanDoAction for command number 3/6 (Command type: ShutdownVm) >2012-08-06 15:09:12,478 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) Start time: 8/6/12 3:09 PM. Start running CanDoAction for command number 2/6 (Command type: ShutdownVm) >2012-08-06 15:09:12,481 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) Start time: 8/6/12 3:09 PM. Start running CanDoAction for command number 1/6 (Command type: ShutdownVm) >2012-08-06 15:09:12,478 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/6/12 3:09 PM. Start running CanDoAction for command number 4/6 (Command type: ShutdownVm) >2012-08-06 15:09:12,496 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/6/12 3:09 PM. Start running CanDoAction for command number 5/6 (Command type: ShutdownVm) >2012-08-06 15:09:12,502 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/6/12 3:09 PM. Start running CanDoAction for command number 6/6 (Command type: ShutdownVm) >2012-08-06 15:09:12,767 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) End time: 8/6/12 3:09 PM. Finish handling CanDoAction for command number 1/6 (Command type: ShutdownVm) >2012-08-06 15:09:12,780 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) End time: 8/6/12 3:09 PM. Finish handling CanDoAction for command number 2/6 (Command type: ShutdownVm) >2012-08-06 15:09:12,791 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/6/12 3:09 PM. Finish handling CanDoAction for command number 3/6 (Command type: ShutdownVm) >2012-08-06 15:09:12,795 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/6/12 3:09 PM. Finish handling CanDoAction for command number 4/6 (Command type: ShutdownVm) >2012-08-06 15:09:12,830 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/6/12 3:09 PM. Finish handling CanDoAction for command number 5/6 (Command type: ShutdownVm) >2012-08-06 15:09:12,881 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/6/12 3:09 PM. Finish handling CanDoAction for command number 6/6 (Command type: ShutdownVm) >2012-08-06 15:09:13,046 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [4167ad14] Running command: ShutdownVmCommand internal: false. Entities affected : ID: d3c805a2-419c-480f-8627-f5c9ef5c4117 Type: VM >2012-08-06 15:09:13,082 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [4167ad14] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-3). >2012-08-06 15:09:13,082 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [4167ad14] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-3. >2012-08-06 15:09:13,085 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-45) [4167ad14] START, DestroyVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=d3c805a2-419c-480f-8627-f5c9ef5c4117, force=false, secondsToWait=30, gracefully=true), log id: 38bea656 >2012-08-06 15:09:13,116 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-45) [4167ad14] START, DestroyVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=d3c805a2-419c-480f-8627-f5c9ef5c4117, force=false, secondsToWait=30, gracefully=true), log id: 7e2fa50b >2012-08-06 15:09:13,261 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-45) [4167ad14] FINISH, DestroyVDSCommand, log id: 7e2fa50b >2012-08-06 15:09:13,293 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-45) [4167ad14] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 38bea656 >2012-08-06 15:09:13,486 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [138a91bf] Running command: ShutdownVmCommand internal: false. Entities affected : ID: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 Type: VM >2012-08-06 15:09:13,489 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [138a91bf] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-4). >2012-08-06 15:09:13,493 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [138a91bf] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-4. >2012-08-06 15:09:13,501 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-45) [138a91bf] START, DestroyVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861, force=false, secondsToWait=30, gracefully=true), log id: 6277ebc >2012-08-06 15:09:13,617 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-45) [138a91bf] START, DestroyVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861, force=false, secondsToWait=30, gracefully=true), log id: 30e9475e >2012-08-06 15:09:13,737 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-45) [138a91bf] FINISH, DestroyVDSCommand, log id: 30e9475e >2012-08-06 15:09:13,761 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-45) [138a91bf] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 6277ebc >2012-08-06 15:09:13,870 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [6e669c9e] Running command: ShutdownVmCommand internal: false. Entities affected : ID: c1cb365c-a119-493c-964c-faf65a10c889 Type: VM >2012-08-06 15:09:13,878 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [6e669c9e] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-5). >2012-08-06 15:09:13,882 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [6e669c9e] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-5. >2012-08-06 15:09:13,891 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-45) [6e669c9e] START, DestroyVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c1cb365c-a119-493c-964c-faf65a10c889, force=false, secondsToWait=30, gracefully=true), log id: 7001bec2 >2012-08-06 15:09:13,916 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-45) [6e669c9e] START, DestroyVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c1cb365c-a119-493c-964c-faf65a10c889, force=false, secondsToWait=30, gracefully=true), log id: 3d6f6b42 >2012-08-06 15:09:14,039 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-45) [6e669c9e] FINISH, DestroyVDSCommand, log id: 3d6f6b42 >2012-08-06 15:09:14,097 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-45) [6e669c9e] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 7001bec2 >2012-08-06 15:09:14,252 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [12b481b2] Running command: ShutdownVmCommand internal: false. Entities affected : ID: c7702cf0-88da-4885-9b9c-9e59772b3774 Type: VM >2012-08-06 15:09:14,259 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [12b481b2] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-6). >2012-08-06 15:09:14,263 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [12b481b2] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-6. >2012-08-06 15:09:14,270 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-45) [12b481b2] START, DestroyVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c7702cf0-88da-4885-9b9c-9e59772b3774, force=false, secondsToWait=30, gracefully=true), log id: 73d303c >2012-08-06 15:09:14,288 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-45) [12b481b2] START, DestroyVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c7702cf0-88da-4885-9b9c-9e59772b3774, force=false, secondsToWait=30, gracefully=true), log id: 1771a77b >2012-08-06 15:09:14,398 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-45) [12b481b2] FINISH, DestroyVDSCommand, log id: 1771a77b >2012-08-06 15:09:14,422 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-45) [12b481b2] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 73d303c >2012-08-06 15:09:14,430 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) Start time: 8/6/12 3:09 PM. Start running CanDoAction for command number 5/6 (Command type: ShutdownVm) >2012-08-06 15:09:14,430 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) Start time: 8/6/12 3:09 PM. Start running CanDoAction for command number 4/6 (Command type: ShutdownVm) >2012-08-06 15:09:14,430 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/6/12 3:09 PM. Start running CanDoAction for command number 3/6 (Command type: ShutdownVm) >2012-08-06 15:09:14,430 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/6/12 3:09 PM. Start running CanDoAction for command number 2/6 (Command type: ShutdownVm) >2012-08-06 15:09:14,429 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/6/12 3:09 PM. Start running CanDoAction for command number 1/6 (Command type: ShutdownVm) >2012-08-06 15:09:14,464 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) Start time: 8/6/12 3:09 PM. Start running CanDoAction for command number 6/6 (Command type: ShutdownVm) >2012-08-06 15:09:14,484 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/6/12 3:09 PM. Finish handling CanDoAction for command number 3/6 (Command type: ShutdownVm) >2012-08-06 15:09:14,494 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) End time: 8/6/12 3:09 PM. Finish handling CanDoAction for command number 4/6 (Command type: ShutdownVm) >2012-08-06 15:09:14,496 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/6/12 3:09 PM. Finish handling CanDoAction for command number 1/6 (Command type: ShutdownVm) >2012-08-06 15:09:14,502 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/6/12 3:09 PM. Finish handling CanDoAction for command number 2/6 (Command type: ShutdownVm) >2012-08-06 15:09:14,617 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) End time: 8/6/12 3:09 PM. Finish handling CanDoAction for command number 5/6 (Command type: ShutdownVm) >2012-08-06 15:09:14,666 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) End time: 8/6/12 3:09 PM. Finish handling CanDoAction for command number 6/6 (Command type: ShutdownVm) >2012-08-06 15:09:15,017 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [3074cbc2] Running command: ShutdownVmCommand internal: false. Entities affected : ID: d3c805a2-419c-480f-8627-f5c9ef5c4117 Type: VM >2012-08-06 15:09:15,030 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [8aed6b6] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 3ce0f220-6cb8-42d8-b922-7003c60ccdad Type: VM >2012-08-06 15:09:15,032 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [8aed6b6] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-7). >2012-08-06 15:09:15,041 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [8aed6b6] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-7. >2012-08-06 15:09:15,049 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-45) [8aed6b6] START, DestroyVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad, force=false, secondsToWait=30, gracefully=true), log id: 3bdd7560 >2012-08-06 15:09:15,076 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [3074cbc2] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-3). >2012-08-06 15:09:15,076 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [3074cbc2] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-3, status is not up. Stopping instead. >2012-08-06 15:09:15,081 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-45) [8aed6b6] START, DestroyVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad, force=false, secondsToWait=30, gracefully=true), log id: 4a723cb5 >2012-08-06 15:09:15,111 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-44) [1f19351b] Running command: StopVmCommand internal: true. Entities affected : ID: d3c805a2-419c-480f-8627-f5c9ef5c4117 Type: VM >2012-08-06 15:09:15,123 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [1f19351b] START, DestroyVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=d3c805a2-419c-480f-8627-f5c9ef5c4117, force=false, secondsToWait=0, gracefully=false), log id: 1d0f5039 >2012-08-06 15:09:15,224 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-45) [8aed6b6] FINISH, DestroyVDSCommand, log id: 4a723cb5 >2012-08-06 15:09:15,256 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-45) [8aed6b6] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 3bdd7560 >2012-08-06 15:09:15,268 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [1f19351b] START, DestroyVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=d3c805a2-419c-480f-8627-f5c9ef5c4117, force=false, secondsToWait=0, gracefully=false), log id: 1c14a56f >2012-08-06 15:09:15,407 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [e924b2e] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 6df57989-99a7-4ec9-8f7c-15f222064e61 Type: VM >2012-08-06 15:09:15,409 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [e924b2e] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-2). >2012-08-06 15:09:15,413 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [e924b2e] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-2. >2012-08-06 15:09:15,420 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-45) [e924b2e] START, DestroyVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=6df57989-99a7-4ec9-8f7c-15f222064e61, force=false, secondsToWait=30, gracefully=true), log id: 658d5362 >2012-08-06 15:09:15,804 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [1f19351b] FINISH, DestroyVDSCommand, log id: 1c14a56f >2012-08-06 15:09:15,858 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [1f19351b] FINISH, DestroyVmVDSCommand, return: Down, log id: 1d0f5039 >2012-08-06 15:09:16,149 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [43ed4668] Running command: ShutdownVmCommand internal: false. Entities affected : ID: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 Type: VM >2012-08-06 15:09:16,157 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [43ed4668] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-4). >2012-08-06 15:09:16,162 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-45) [e924b2e] START, DestroyVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=6df57989-99a7-4ec9-8f7c-15f222064e61, force=false, secondsToWait=30, gracefully=true), log id: 62569453 >2012-08-06 15:09:16,168 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [43ed4668] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-4, status is not up. Stopping instead. >2012-08-06 15:09:16,185 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-44) [22240795] Running command: StopVmCommand internal: true. Entities affected : ID: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 Type: VM >2012-08-06 15:09:16,195 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [22240795] START, DestroyVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861, force=false, secondsToWait=0, gracefully=false), log id: 5deb8f4 >2012-08-06 15:09:16,398 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-45) [e924b2e] FINISH, DestroyVDSCommand, log id: 62569453 >2012-08-06 15:09:16,418 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [22240795] START, DestroyVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861, force=false, secondsToWait=0, gracefully=false), log id: 7f987498 >2012-08-06 15:09:16,422 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-45) [e924b2e] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 658d5362 >2012-08-06 15:09:16,899 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [22240795] FINISH, DestroyVDSCommand, log id: 7f987498 >2012-08-06 15:09:16,941 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [22240795] FINISH, DestroyVmVDSCommand, return: Down, log id: 5deb8f4 >2012-08-06 15:09:17,056 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [ea978af] Running command: ShutdownVmCommand internal: false. Entities affected : ID: c1cb365c-a119-493c-964c-faf65a10c889 Type: VM >2012-08-06 15:09:17,061 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [ea978af] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-5). >2012-08-06 15:09:17,064 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [ea978af] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-5, status is not up. Stopping instead. >2012-08-06 15:09:17,071 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-44) [2f0c29e8] Running command: StopVmCommand internal: true. Entities affected : ID: c1cb365c-a119-493c-964c-faf65a10c889 Type: VM >2012-08-06 15:09:17,075 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [2f0c29e8] START, DestroyVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c1cb365c-a119-493c-964c-faf65a10c889, force=false, secondsToWait=0, gracefully=false), log id: 5f9833c >2012-08-06 15:09:17,088 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [2f0c29e8] START, DestroyVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c1cb365c-a119-493c-964c-faf65a10c889, force=false, secondsToWait=0, gracefully=false), log id: 2e1f08f1 >2012-08-06 15:09:17,584 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [2f0c29e8] FINISH, DestroyVDSCommand, log id: 2e1f08f1 >2012-08-06 15:09:17,614 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [2f0c29e8] FINISH, DestroyVmVDSCommand, return: Down, log id: 5f9833c >2012-08-06 15:09:17,746 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [183230ae] Running command: ShutdownVmCommand internal: false. Entities affected : ID: c7702cf0-88da-4885-9b9c-9e59772b3774 Type: VM >2012-08-06 15:09:17,749 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [183230ae] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-6). >2012-08-06 15:09:17,754 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [183230ae] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-6, status is not up. Stopping instead. >2012-08-06 15:09:17,765 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-44) [1613ea75] Running command: StopVmCommand internal: true. Entities affected : ID: c7702cf0-88da-4885-9b9c-9e59772b3774 Type: VM >2012-08-06 15:09:17,773 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [1613ea75] START, DestroyVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c7702cf0-88da-4885-9b9c-9e59772b3774, force=false, secondsToWait=0, gracefully=false), log id: 2a39fdd0 >2012-08-06 15:09:17,787 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [1613ea75] START, DestroyVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c7702cf0-88da-4885-9b9c-9e59772b3774, force=false, secondsToWait=0, gracefully=false), log id: c209d40 >2012-08-06 15:09:18,322 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [1613ea75] FINISH, DestroyVDSCommand, log id: c209d40 >2012-08-06 15:09:18,342 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [1613ea75] FINISH, DestroyVmVDSCommand, return: Down, log id: 2a39fdd0 >2012-08-06 15:09:18,537 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [719fbeb] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 3ce0f220-6cb8-42d8-b922-7003c60ccdad Type: VM >2012-08-06 15:09:18,544 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [719fbeb] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-7). >2012-08-06 15:09:18,547 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [719fbeb] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-7. >2012-08-06 15:09:18,557 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [719fbeb] START, DestroyVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad, force=false, secondsToWait=30, gracefully=true), log id: 23c708ab >2012-08-06 15:09:18,653 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [719fbeb] START, DestroyVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad, force=false, secondsToWait=30, gracefully=true), log id: 69710f9e >2012-08-06 15:09:18,801 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [719fbeb] FINISH, DestroyVDSCommand, log id: 69710f9e >2012-08-06 15:09:18,823 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [719fbeb] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 23c708ab >2012-08-06 15:09:18,995 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [3aea04f1] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 6df57989-99a7-4ec9-8f7c-15f222064e61 Type: VM >2012-08-06 15:09:19,000 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [3aea04f1] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-2). >2012-08-06 15:09:19,003 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [3aea04f1] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-2. >2012-08-06 15:09:19,011 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [3aea04f1] START, DestroyVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=6df57989-99a7-4ec9-8f7c-15f222064e61, force=false, secondsToWait=30, gracefully=true), log id: 77dd86b6 >2012-08-06 15:09:19,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [3aea04f1] START, DestroyVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=6df57989-99a7-4ec9-8f7c-15f222064e61, force=false, secondsToWait=30, gracefully=true), log id: 5a5de7d7 >2012-08-06 15:09:19,127 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [3aea04f1] FINISH, DestroyVDSCommand, log id: 5a5de7d7 >2012-08-06 15:09:19,146 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [3aea04f1] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 77dd86b6 >2012-08-06 15:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable hosts >2012-08-06 15:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Autorecovering 0 hosts >2012-08-06 15:10:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable hosts done >2012-08-06 15:10:00,021 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable storage domains >2012-08-06 15:10:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Autorecovering 0 storage domains >2012-08-06 15:10:00,042 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable storage domains done >2012-08-06 15:13:31,900 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-40) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:13:33,915 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-48) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:13:35,957 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-52) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:13:37,842 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-53) [423b10c5] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-06 15:13:37,930 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) [423b10c5] IrsBroker::Failed::GetStoragePoolInfoVDS due to: ConnectException: Connection refused >2012-08-06 15:13:37,974 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-54) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:13:39,987 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-67) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:13:42,010 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-65) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:13:44,029 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-66) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:13:46,044 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-64) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:13:47,958 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) IrsBroker::Failed::GetStoragePoolInfoVDS due to: ConnectException: Connection refused >2012-08-06 15:13:48,057 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-76) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:13:50,070 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-80) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:13:52,082 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-82) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:13:54,100 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-91) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:13:56,115 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-86) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:13:57,982 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) IrsBroker::Failed::GetStoragePoolInfoVDS due to: ConnectException: Connection refused >2012-08-06 15:13:58,137 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-89) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:14:00,157 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-97) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:14:02,172 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-99) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:14:04,185 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-96) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:14:06,201 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-3) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:14:07,999 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) IrsBroker::Failed::GetStoragePoolInfoVDS due to: ConnectException: Connection refused >2012-08-06 15:14:08,220 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-6) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:14:10,241 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-16) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:14:12,256 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-18) [6a0b4f90] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:14:14,270 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-12) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:14:16,283 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-17) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:14:18,020 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) IrsBroker::Failed::GetStoragePoolInfoVDS due to: ConnectException: Connection refused >2012-08-06 15:14:18,297 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-31) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:14:20,310 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-30) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:14:22,331 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-36) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:14:24,345 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-39) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:14:26,358 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-43) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:14:28,037 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-51) IrsBroker::Failed::GetStoragePoolInfoVDS due to: ConnectException: Connection refused >2012-08-06 15:14:28,378 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-44) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 15:14:30,391 ERROR [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-49) VDS::handleNetworkException Server failed to respond, vds_id = 47028088-dee6-11e1-bffa-2f8f15de3134, vds_name = purple-vds3, error = VDSNetworkException: >2012-08-06 15:14:30,438 INFO [org.ovirt.engine.core.bll.VdsEventListener] (pool-3-thread-44) ResourceManager::vdsNotResponding entered for Host 47028088-dee6-11e1-bffa-2f8f15de3134, purple-vds3 >2012-08-06 15:14:30,510 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-44) [113644b6] START, SetVmStatusVDSCommand(vmId = 3ce0f220-6cb8-42d8-b922-7003c60ccdad, status = Unknown), log id: 79561029 >2012-08-06 15:14:30,539 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-44) [113644b6] FINISH, SetVmStatusVDSCommand, log id: 79561029 >2012-08-06 15:14:30,560 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-44) [113644b6] START, SetVmStatusVDSCommand(vmId = 6df57989-99a7-4ec9-8f7c-15f222064e61, status = Unknown), log id: a811df0 >2012-08-06 15:14:30,585 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-44) [113644b6] FINISH, SetVmStatusVDSCommand, log id: a811df0 >2012-08-06 15:14:30,618 INFO [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (pool-3-thread-44) [113644b6] Fence failed on vds purple-vds3 which is spm of pool efe20197-e0a7-49b8-beb4-19b1ed3f8c3f - moving pool to non operational >2012-08-06 15:14:30,625 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (pool-3-thread-44) [5a2e9b94] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-06 15:14:30,669 ERROR [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (pool-3-thread-44) [5a2e9b94] Failed to run Fence script on vds:purple-vds3, VMs moved to UnKnown instead. >2012-08-06 15:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable hosts >2012-08-06 15:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Autorecovering 0 hosts >2012-08-06 15:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable hosts done >2012-08-06 15:15:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable storage domains >2012-08-06 15:15:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Autorecovering 0 storage domains >2012-08-06 15:15:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable storage domains done >2012-08-06 15:17:30,638 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (QuartzScheduler_Worker-65) Adding new value to configuration cache. >2012-08-06 15:17:30,641 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (QuartzScheduler_Worker-65) Didnt find the value of DBI18NPrefix in DB for version general - using default: >2012-08-06 15:18:25,966 WARN [org.ovirt.engine.core.bll.MaintananceNumberOfVdssCommand] (ajp--127.0.0.1-8009-9) CanDoAction of action MaintananceNumberOfVdss failed. Reasons:VDS_CANNOT_MAINTENANCE_VDS_IS_NOT_RESPONDING_WITH_VMS,$HostNotResponding purple-vds3 >2012-08-06 15:18:38,931 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp--127.0.0.1-8009-3) Lock Acquired to object EngineLock [exclusiveLocks= key: 4196a566-dee6-11e1-b66e-c35c5273fee7 value: VDS >, sharedLocks= ] >2012-08-06 15:18:39,017 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-3-thread-44) [477faae2] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 15:18:39,027 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-44) [477faae2] START, SetVdsStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, status=Unassigned, nonOperationalReason=NONE), log id: 5e85e05a >2012-08-06 15:18:39,039 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-44) [477faae2] FINISH, SetVdsStatusVDSCommand, log id: 5e85e05a >2012-08-06 15:18:39,084 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (pool-3-thread-44) [477faae2] START, ActivateVdsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7), log id: 59baa2aa >2012-08-06 15:18:39,995 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (pool-3-thread-44) [221cd08] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 15:18:40,000 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (pool-3-thread-44) [4ce8d591] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 15:18:40,010 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (pool-3-thread-44) [4ce8d591] FINISH, ActivateVdsVDSCommand, log id: 59baa2aa >2012-08-06 15:18:40,078 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-3-thread-44) [4ce8d591] Lock freed to object EngineLock [exclusiveLocks= key: 4196a566-dee6-11e1-b66e-c35c5273fee7 value: VDS >, sharedLocks= ] >2012-08-06 15:18:40,705 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-88) [47726730] Running command: InitVdsOnUpCommand internal: true. >2012-08-06 15:18:40,816 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-88) [30461aec] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-06 15:18:40,821 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-88) [30461aec] START, ConnectStorageServerVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, storageType = NFS, connectionList = [{ id: f6121783-5d14-493d-a12e-9b31402f985b, connection: orion.qa.lab.tlv.redhat.com:/export/lesik };]), log id: 1e6a0e92 >2012-08-06 15:18:40,899 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-88) [30461aec] FINISH, ConnectStorageServerVDSCommand, return: {f6121783-5d14-493d-a12e-9b31402f985b=0}, log id: 1e6a0e92 >2012-08-06 15:18:40,918 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-88) [30461aec] Host purple-vds2 storage connection was succeeded >2012-08-06 15:18:40,953 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-88) [30461aec] START, ConnectStoragePoolVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, vds_spm_id = 1, masterDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, masterVersion = 1), log id: 37c5981 >2012-08-06 15:18:43,406 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-88) [30461aec] FINISH, ConnectStoragePoolVDSCommand, log id: 37c5981 >2012-08-06 15:18:43,419 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-88) [30461aec] No string for UNASSIGNED type. Use default Log >2012-08-06 15:18:43,435 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) [30461aec] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-08-06 15:18:43,475 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-88) [5eac4a91] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 15:18:43,483 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-88) [6b0eed98] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-06 15:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Checking autorecoverable hosts >2012-08-06 15:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Autorecovering 0 hosts >2012-08-06 15:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Checking autorecoverable hosts done >2012-08-06 15:20:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Checking autorecoverable storage domains >2012-08-06 15:20:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Autorecovering 0 storage domains >2012-08-06 15:20:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Checking autorecoverable storage domains done >2012-08-06 15:20:45,547 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-95) Command org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand return value > org.ovirt.engine.core.vdsbroker.vdsbroker.VDSInfoReturnForXmlRpc@7df136f9 >2012-08-06 15:20:45,548 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-95) Vds: purple-vds3 >2012-08-06 15:20:45,549 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (QuartzScheduler_Worker-95) Command GetCapabilitiesVDS execution failed. Error: VDSRecoveringException: Recovering from crash or Initializing >2012-08-06 15:20:45,597 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-95) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, error = Recovering from crash or Initializing, continuing. >2012-08-06 15:20:48,404 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-92) VM pool1-7 3ce0f220-6cb8-42d8-b922-7003c60ccdad moved from Unknown --> Up >2012-08-06 15:20:48,406 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-92) VM pool1-2 6df57989-99a7-4ec9-8f7c-15f222064e61 moved from Unknown --> Up >2012-08-06 15:20:48,409 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-92) Cancelling the recovery from crash timer for VDS 47028088-dee6-11e1-bffa-2f8f15de3134 because vds started initializing >2012-08-06 15:20:48,419 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-92) [58990d41] Running command: InitVdsOnUpCommand internal: true. >2012-08-06 15:20:48,611 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (QuartzScheduler_Worker-92) [6e24868a] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, storageType = NFS, connectionList = [{ id: f6121783-5d14-493d-a12e-9b31402f985b, connection: orion.qa.lab.tlv.redhat.com:/export/lesik };]), log id: 74021beb >2012-08-06 15:20:48,639 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (QuartzScheduler_Worker-92) [6e24868a] FINISH, ValidateStorageServerConnectionVDSCommand, return: {f6121783-5d14-493d-a12e-9b31402f985b=0}, log id: 74021beb >2012-08-06 15:20:48,641 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-92) [6e24868a] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-06 15:20:48,649 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-92) [6e24868a] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, storageType = NFS, connectionList = [{ id: f6121783-5d14-493d-a12e-9b31402f985b, connection: orion.qa.lab.tlv.redhat.com:/export/lesik };]), log id: 8c451a >2012-08-06 15:20:48,683 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-92) [6e24868a] FINISH, ConnectStorageServerVDSCommand, return: {f6121783-5d14-493d-a12e-9b31402f985b=0}, log id: 8c451a >2012-08-06 15:20:48,684 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-92) [6e24868a] Host purple-vds3 storage connection was succeeded >2012-08-06 15:20:48,730 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-92) [6e24868a] START, ConnectStoragePoolVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, vds_spm_id = 2, masterDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, masterVersion = 1), log id: 6ddc0d44 >2012-08-06 15:20:49,926 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-92) [6e24868a] FINISH, ConnectStoragePoolVDSCommand, log id: 6ddc0d44 >2012-08-06 15:20:49,972 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-92) [6e24868a] No string for UNASSIGNED type. Use default Log >2012-08-06 15:20:49,978 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) [6e24868a] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-08-06 15:20:50,123 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-92) [38b702dc] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 15:20:50,132 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-92) [47c8ae26] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 15:20:58,200 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-14) hostFromVds::selectedVds - purple-vds2, spmStatus Free, storage pool nfs31 >2012-08-06 15:20:58,284 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-14) SpmStatus on vds 47028088-dee6-11e1-bffa-2f8f15de3134: Free >2012-08-06 15:20:58,331 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-14) starting spm on vds purple-vds2, storage pool nfs31, prevId 2, LVER 3 >2012-08-06 15:20:58,335 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) START, SpmStartVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, prevId=2, prevLVER=3, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 26768afc >2012-08-06 15:20:58,366 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) spmStart polling started: taskId = f1a337d1-72db-412d-8502-9cdf53b0a371 >2012-08-06 15:20:59,405 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) spmStart polling ended: taskId = f1a337d1-72db-412d-8502-9cdf53b0a371 task status = finished >2012-08-06 15:20:59,434 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) spmStart polling ended. spm status: SPM >2012-08-06 15:20:59,437 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-14) START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=f1a337d1-72db-412d-8502-9cdf53b0a371), log id: 500fd264 >2012-08-06 15:20:59,463 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-14) FINISH, HSMClearTaskVDSCommand, log id: 500fd264 >2012-08-06 15:20:59,466 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@20bf474b, log id: 26768afc >2012-08-06 15:20:59,629 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-14) Initialize Irs proxy from vds: purple-vds2 >2012-08-06 15:20:59,791 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-27) Attempting to get and stop tasks on storage pool nfs31 >2012-08-06 15:20:59,792 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-27) START, SPMGetAllTasksInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6be25034 >2012-08-06 15:20:59,978 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-27) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool efe20197-e0a7-49b8-beb4-19b1ed3f8c3f >2012-08-06 15:20:59,981 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-27) START, HSMGetAllTasksInfoVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7), log id: 50b8cc3e >2012-08-06 15:21:00,016 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-27) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 50b8cc3e >2012-08-06 15:21:00,017 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-27) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 6be25034 >2012-08-06 15:21:00,017 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-27) Discovered no tasks on Storage Pool nfs31 >2012-08-06 15:21:00,022 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-27) START, SPMGetAllTasksInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 116d1bc0 >2012-08-06 15:21:00,023 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-27) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool efe20197-e0a7-49b8-beb4-19b1ed3f8c3f >2012-08-06 15:21:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-27) START, HSMGetAllTasksInfoVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7), log id: 1ff1a404 >2012-08-06 15:21:00,061 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-27) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 1ff1a404 >2012-08-06 15:21:00,062 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-27) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 116d1bc0 >2012-08-06 15:21:00,063 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-27) Discovered no tasks on Storage Pool nfs31 >2012-08-06 15:21:55,805 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8009-10) Lock Acquired to object EngineLock [exclusiveLocks= key: 3c7c0453-5f05-4314-bdd4-eb4fd243f80a value: VM >, sharedLocks= ] >2012-08-06 15:21:55,824 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-10) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4865c524 >2012-08-06 15:21:55,830 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-10) FINISH, IsValidVDSCommand, return: true, log id: 4865c524 >2012-08-06 15:21:55,870 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-10) START, IsVmDuringInitiatingVDSCommand(vmId = 3c7c0453-5f05-4314-bdd4-eb4fd243f80a), log id: 1d1223a >2012-08-06 15:21:55,874 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-10) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 1d1223a >2012-08-06 15:21:55,971 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [3dcc98ac] Running command: RunVmCommand internal: false. Entities affected : ID: 3c7c0453-5f05-4314-bdd4-eb4fd243f80a Type: VM >2012-08-06 15:21:56,013 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [3dcc98ac] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=3c7c0453-5f05-4314-bdd4-eb4fd243f80a, vm=org.ovirt.engine.core.common.businessentities.VM@42eb5d60), log id: 3f15c915 >2012-08-06 15:21:56,032 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [3dcc98ac] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=3c7c0453-5f05-4314-bdd4-eb4fd243f80a, vm=org.ovirt.engine.core.common.businessentities.VM@42eb5d60), log id: e2d8f78 >2012-08-06 15:21:56,173 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [3dcc98ac] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=3c7c0453-5f05-4314-bdd4-eb4fd243f80a,devices=[Ljava.util.Map;@3bde51d8,acpiEnable=true,vmName=pool1-1,cpuType=Conroe,custom={} >2012-08-06 15:21:56,179 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [3dcc98ac] FINISH, CreateVDSCommand, log id: e2d8f78 >2012-08-06 15:21:56,199 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [3dcc98ac] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 1. Vm: pool1-1 >2012-08-06 15:21:56,243 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [3dcc98ac] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 3f15c915 >2012-08-06 15:21:56,244 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [3dcc98ac] Lock freed to object EngineLock [exclusiveLocks= key: 3c7c0453-5f05-4314-bdd4-eb4fd243f80a value: VM >, sharedLocks= ] >2012-08-06 15:21:57,850 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-13) VM pool1-1 3c7c0453-5f05-4314-bdd4-eb4fd243f80a moved from WaitForLaunch --> PoweringUp >2012-08-06 15:21:57,857 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-13) START, FullListVdsCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=null, vmIds=[3c7c0453-5f05-4314-bdd4-eb4fd243f80a]), log id: 572336e9 >2012-08-06 15:21:57,894 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-13) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@48ea27b0, log id: 572336e9 >2012-08-06 15:22:57,057 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-25) VM pool1-1 3c7c0453-5f05-4314-bdd4-eb4fd243f80a moved from PoweringUp --> Up >2012-08-06 15:22:57,082 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-25) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@4edd9ff4), log id: 2fc666aa >2012-08-06 15:22:57,101 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-25) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 2fc666aa >2012-08-06 15:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable hosts >2012-08-06 15:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Autorecovering 0 hosts >2012-08-06 15:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable hosts done >2012-08-06 15:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable storage domains >2012-08-06 15:25:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Autorecovering 0 storage domains >2012-08-06 15:25:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable storage domains done >2012-08-06 15:26:18,495 INFO [org.ovirt.engine.core.bll.MaintananceNumberOfVdssCommand] (pool-3-thread-45) [74f2185b] Running command: MaintananceNumberOfVdssCommand internal: false. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 15:26:18,498 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-45) [74f2185b] START, SetVdsStatusVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, status=PreparingForMaintenance, nonOperationalReason=NONE), log id: 12d40ed4 >2012-08-06 15:26:18,561 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-45) [74f2185b] FINISH, SetVdsStatusVDSCommand, log id: 12d40ed4 >2012-08-06 15:26:18,670 INFO [org.ovirt.engine.core.bll.MaintananceVdsCommand] (pool-3-thread-45) [4d2c291f] Running command: MaintananceVdsCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 15:26:18,787 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (pool-3-thread-45) [1d87f6bc] Running command: InternalMigrateVmCommand internal: true. Entities affected : ID: 3ce0f220-6cb8-42d8-b922-7003c60ccdad Type: VM >2012-08-06 15:26:18,803 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-45) [1d87f6bc] START, MigrateVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad, srcHost=purple-vds3, dstVdsId=4196a566-dee6-11e1-b66e-c35c5273fee7, dstHost=purple-vds2:54321, migrationMethod=ONLINE), log id: 4c0bcbbc >2012-08-06 15:26:18,812 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-45) [1d87f6bc] VdsBroker::migrate::Entered (vm_guid=3ce0f220-6cb8-42d8-b922-7003c60ccdad, srcHost=purple-vds3, dstHost=purple-vds2:54321, method=online >2012-08-06 15:26:18,817 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-45) [1d87f6bc] START, MigrateBrokerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad, srcHost=purple-vds3, dstVdsId=4196a566-dee6-11e1-b66e-c35c5273fee7, dstHost=purple-vds2:54321, migrationMethod=ONLINE), log id: 2dbf5d91 >2012-08-06 15:26:18,844 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-45) [1d87f6bc] FINISH, MigrateBrokerVDSCommand, log id: 2dbf5d91 >2012-08-06 15:26:18,866 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-45) [1d87f6bc] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 4c0bcbbc >2012-08-06 15:26:18,952 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (pool-3-thread-45) [4f379199] Running command: InternalMigrateVmCommand internal: true. Entities affected : ID: 6df57989-99a7-4ec9-8f7c-15f222064e61 Type: VM >2012-08-06 15:26:18,972 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-45) [4f379199] START, MigrateVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=6df57989-99a7-4ec9-8f7c-15f222064e61, srcHost=purple-vds3, dstVdsId=4196a566-dee6-11e1-b66e-c35c5273fee7, dstHost=purple-vds2:54321, migrationMethod=ONLINE), log id: 384bc6ed >2012-08-06 15:26:18,978 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-45) [4f379199] VdsBroker::migrate::Entered (vm_guid=6df57989-99a7-4ec9-8f7c-15f222064e61, srcHost=purple-vds3, dstHost=purple-vds2:54321, method=online >2012-08-06 15:26:18,983 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-45) [4f379199] START, MigrateBrokerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=6df57989-99a7-4ec9-8f7c-15f222064e61, srcHost=purple-vds3, dstVdsId=4196a566-dee6-11e1-b66e-c35c5273fee7, dstHost=purple-vds2:54321, migrationMethod=ONLINE), log id: 3b24b586 >2012-08-06 15:26:19,011 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-45) [4f379199] FINISH, MigrateBrokerVDSCommand, log id: 3b24b586 >2012-08-06 15:26:19,054 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-45) [4f379199] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 384bc6ed >2012-08-06 15:26:19,559 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-83) vds::refreshVmList vm id 3ce0f220-6cb8-42d8-b922-7003c60ccdad is migrating to vds purple-vds2 ignoring it in the refresh till migration is done >2012-08-06 15:26:21,732 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-84) vds::refreshVmList vm id 3ce0f220-6cb8-42d8-b922-7003c60ccdad is migrating to vds purple-vds2 ignoring it in the refresh till migration is done >2012-08-06 15:26:21,734 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-84) vds::refreshVmList vm id 6df57989-99a7-4ec9-8f7c-15f222064e61 is migrating to vds purple-vds2 ignoring it in the refresh till migration is done >2012-08-06 15:26:23,853 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-82) START, FullListVdsCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=null, vmIds=[3ce0f220-6cb8-42d8-b922-7003c60ccdad, 6df57989-99a7-4ec9-8f7c-15f222064e61]), log id: 256d949f >2012-08-06 15:26:23,888 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-82) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@53aeb373, log id: 256d949f >2012-08-06 15:26:23,939 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-75) START, DestroyVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad, force=false, secondsToWait=0, gracefully=false), log id: 35914979 >2012-08-06 15:26:24,046 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-75) FINISH, DestroyVDSCommand, log id: 35914979 >2012-08-06 15:26:24,049 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-75) START, DestroyVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=6df57989-99a7-4ec9-8f7c-15f222064e61, force=false, secondsToWait=0, gracefully=false), log id: 5c1fd1b6 >2012-08-06 15:26:24,150 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-75) FINISH, DestroyVDSCommand, log id: 5c1fd1b6 >2012-08-06 15:26:24,152 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-75) Setting VM pool1-2 6df57989-99a7-4ec9-8f7c-15f222064e61 to status unknown >2012-08-06 15:26:24,157 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-75) vm pool1-2 running in db and not running in vds - add to rerun treatment. vds purple-vds3 >2012-08-06 15:26:24,169 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-75) Setting VM pool1-7 3ce0f220-6cb8-42d8-b922-7003c60ccdad to status unknown >2012-08-06 15:26:24,182 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-75) vm pool1-7 running in db and not running in vds - add to rerun treatment. vds purple-vds3 >2012-08-06 15:26:26,427 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-91) VM pool1-7 3ce0f220-6cb8-42d8-b922-7003c60ccdad moved from Unknown --> Up >2012-08-06 15:26:26,429 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-91) VM pool1-2 6df57989-99a7-4ec9-8f7c-15f222064e61 moved from Unknown --> Up >2012-08-06 15:26:26,432 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-91) START, FullListVdsCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=null, vmIds=[3ce0f220-6cb8-42d8-b922-7003c60ccdad, 6df57989-99a7-4ec9-8f7c-15f222064e61]), log id: 11df2fcc >2012-08-06 15:26:26,467 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-91) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@6671c04, log id: 11df2fcc >2012-08-06 15:26:26,564 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-93) vds::Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3 >2012-08-06 15:26:26,701 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) Clearing cache of pool: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f for problematic entities of VDS: purple-vds3. >2012-08-06 15:26:26,708 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (QuartzScheduler_Worker-93) START, DisconnectStoragePoolVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, vds_spm_id = 2, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 0), log id: 5062d6dc >2012-08-06 15:26:28,746 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (QuartzScheduler_Worker-93) FINISH, DisconnectStoragePoolVDSCommand, log id: 5062d6dc >2012-08-06 15:26:28,757 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (QuartzScheduler_Worker-93) [406cbd81] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-06 15:26:28,782 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (QuartzScheduler_Worker-93) [406cbd81] START, DisconnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, storageType = NFS, connectionList = [{ id: f6121783-5d14-493d-a12e-9b31402f985b, connection: orion.qa.lab.tlv.redhat.com:/export/lesik };]), log id: 5f17b42 >2012-08-06 15:26:29,349 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (QuartzScheduler_Worker-93) [406cbd81] FINISH, DisconnectStorageServerVDSCommand, return: {f6121783-5d14-493d-a12e-9b31402f985b=0}, log id: 5f17b42 >2012-08-06 15:26:44,836 INFO [org.ovirt.engine.core.bll.AddVdsGroupCommand] (ajp--127.0.0.1-8009-1) [1222ab0d] Running command: AddVdsGroupCommand internal: false. Entities affected : ID: 7a858a05-d5d9-40de-9a4e-c24b1980eb23 Type: StoragePool >2012-08-06 15:26:53,697 INFO [org.ovirt.engine.core.bll.ChangeVDSClusterCommand] (ajp--127.0.0.1-8009-1) [5346d27a] Running command: ChangeVDSClusterCommand internal: false. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS, ID: fc11e686-dfc1-11e1-a8f6-5b4cf6aee813 Type: VdsGroups >2012-08-06 15:26:53,861 INFO [org.ovirt.engine.core.bll.RemoveVdsSpmIdCommand] (ajp--127.0.0.1-8009-1) [5346d27a] Running command: RemoveVdsSpmIdCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 15:26:53,907 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp--127.0.0.1-8009-1) [5346d27a] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 15:26:53,950 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp--127.0.0.1-8009-1) [5346d27a] Lock freed to object EngineLock [exclusiveLocks= key: 7a858a05-d5d9-40de-9a4e-c24b1980eb23 value: REGISTER_VDS >, sharedLocks= ] >2012-08-06 15:26:54,051 INFO [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp--127.0.0.1-8009-2) [6fb530da] Running command: UpdateVdsCommand internal: false. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 15:27:06,843 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp--127.0.0.1-8009-4) Lock Acquired to object EngineLock [exclusiveLocks= key: 47028088-dee6-11e1-bffa-2f8f15de3134 value: VDS >, sharedLocks= ] >2012-08-06 15:27:06,933 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-3-thread-49) [566f161e] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 15:27:06,979 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-49) [566f161e] START, SetVdsStatusVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, status=Unassigned, nonOperationalReason=NONE), log id: 30828add >2012-08-06 15:27:06,986 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-49) [566f161e] FINISH, SetVdsStatusVDSCommand, log id: 30828add >2012-08-06 15:27:07,018 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (pool-3-thread-49) [566f161e] START, ActivateVdsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134), log id: af2fbeb >2012-08-06 15:27:07,419 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (pool-3-thread-49) [4df951c7] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 15:27:07,426 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (pool-3-thread-49) [6a268f2] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 15:27:07,433 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (pool-3-thread-49) [6a268f2] FINISH, ActivateVdsVDSCommand, log id: af2fbeb >2012-08-06 15:27:07,481 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-3-thread-49) [6a268f2] Lock freed to object EngineLock [exclusiveLocks= key: 47028088-dee6-11e1-bffa-2f8f15de3134 value: VDS >, sharedLocks= ] >2012-08-06 15:27:07,995 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-54) [244479c8] Running command: InitVdsOnUpCommand internal: true. >2012-08-06 15:27:08,021 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-54) [244479c8] No string for UNASSIGNED type. Use default Log >2012-08-06 15:27:08,031 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) [244479c8] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-08-06 15:27:08,049 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-54) [12498227] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 15:27:08,065 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-54) [28b7172b] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 15:27:13,039 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-3) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 230b99f0 >2012-08-06 15:27:13,876 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-3) FINISH, GetDeviceListVDSCommand, return: [], log id: 230b99f0 >2012-08-06 15:27:18,699 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-8) START, DiscoverSendTargetsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, connection=org.ovirt.engine.core.common.businessentities.storage_server_connections@0), log id: 79b18487 >2012-08-06 15:27:19,080 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-8) FINISH, DiscoverSendTargetsVDSCommand, return: [org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0], log id: 79b18487 >2012-08-06 15:27:24,277 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-4) [31b3cccb] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.81 };]), log id: 4c658181 >2012-08-06 15:27:24,310 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-4) [31b3cccb] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 4c658181 >2012-08-06 15:27:24,339 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-4) [31b3cccb] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-06 15:27:24,349 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-4) [31b3cccb] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.81 };]), log id: 7c65e74c >2012-08-06 15:27:24,479 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-4) [31b3cccb] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 7c65e74c >2012-08-06 15:27:24,703 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-10) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 23b82c1c >2012-08-06 15:27:25,608 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-10) FINISH, GetDeviceListVDSCommand, return: [], log id: 23b82c1c >2012-08-06 15:27:35,263 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-9) START, DiscoverSendTargetsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, connection=org.ovirt.engine.core.common.businessentities.storage_server_connections@0), log id: 2be7d0ce >2012-08-06 15:27:35,564 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-9) FINISH, DiscoverSendTargetsVDSCommand, return: [org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0], log id: 2be7d0ce >2012-08-06 15:27:41,312 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-10) [3b00ff80] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.10 };]), log id: 317f809 >2012-08-06 15:27:41,340 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-10) [3b00ff80] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 317f809 >2012-08-06 15:27:41,385 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-10) [3b00ff80] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-06 15:27:41,389 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-10) [3b00ff80] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.10 };]), log id: 26d95315 >2012-08-06 15:27:42,038 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-10) [3b00ff80] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 26d95315 >2012-08-06 15:27:42,685 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-4) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 503893bd >2012-08-06 15:27:43,506 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-4) FINISH, GetDeviceListVDSCommand, return: [], log id: 503893bd >2012-08-06 15:27:53,800 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-1) [43cde987] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.10 };]), log id: 66a4621d >2012-08-06 15:27:53,839 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-1) [43cde987] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 66a4621d >2012-08-06 15:27:53,921 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-1) [43cde987] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-06 15:27:53,932 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-1) [43cde987] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.10 };]), log id: 41c58fca >2012-08-06 15:27:54,611 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-1) [43cde987] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 41c58fca >2012-08-06 15:27:55,307 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-7) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 2a4296d4 >2012-08-06 15:27:56,232 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-7) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed], log id: 2a4296d4 >2012-08-06 15:28:01,595 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-9) [7d0762a7] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.10 };]), log id: 569f649f >2012-08-06 15:28:01,623 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-9) [7d0762a7] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 569f649f >2012-08-06 15:28:01,685 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-9) [7d0762a7] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-06 15:28:01,691 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-9) [7d0762a7] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.10 };]), log id: 604c3ff3 >2012-08-06 15:28:02,346 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-9) [7d0762a7] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 604c3ff3 >2012-08-06 15:28:02,955 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-1) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: d15281d >2012-08-06 15:28:03,990 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-1) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@829f3c3e], log id: d15281d >2012-08-06 15:28:14,974 INFO [org.ovirt.engine.core.bll.storage.AddSANStorageDomainCommand] (ajp--127.0.0.1-8009-3) [491c7753] Running command: AddSANStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-06 15:28:15,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVGVDSCommand] (ajp--127.0.0.1-8009-3) [491c7753] START, CreateVGVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageDomainId=99bb665e-3421-4afb-bf70-d7b879c591b3, deviceList=[1paikov53], force=false), log id: 3ac902f0 >2012-08-06 15:28:15,989 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVGVDSCommand] (ajp--127.0.0.1-8009-3) [491c7753] FINISH, CreateVGVDSCommand, return: YpSrbN-STV1-GsBY-JVmG-kY4L-2kJZ-nCnAgo, log id: 3ac902f0 >2012-08-06 15:28:15,992 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8009-3) [491c7753] START, CreateStorageDomainVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageDomain=org.ovirt.engine.core.common.businessentities.storage_domain_static@49cf9f33, args=YpSrbN-STV1-GsBY-JVmG-kY4L-2kJZ-nCnAgo), log id: 3baf50ef >2012-08-06 15:28:22,151 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8009-3) [491c7753] FINISH, CreateStorageDomainVDSCommand, log id: 3baf50ef >2012-08-06 15:28:22,158 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp--127.0.0.1-8009-3) [491c7753] START, GetStorageDomainStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageDomainId=99bb665e-3421-4afb-bf70-d7b879c591b3), log id: b6c8874 >2012-08-06 15:28:22,506 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp--127.0.0.1-8009-3) [491c7753] FINISH, GetStorageDomainStatsVDSCommand, return: org.ovirt.engine.core.common.businessentities.storage_domains@20507a1, log id: b6c8874 >2012-08-06 15:28:22,552 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp--127.0.0.1-8009-3) [491c7753] START, GetVGInfoVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, VGID=YpSrbN-STV1-GsBY-JVmG-kY4L-2kJZ-nCnAgo), log id: 37d520bd >2012-08-06 15:28:22,600 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp--127.0.0.1-8009-3) [491c7753] FINISH, GetVGInfoVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@41485b4a], log id: 37d520bd >2012-08-06 15:28:22,996 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8009-10) [272d7260] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 15:28:23,044 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp--127.0.0.1-8009-10) [5fb12c0b] Lock Acquired to object EngineLock [exclusiveLocks= key: 7a858a05-d5d9-40de-9a4e-c24b1980eb23 value: POOL >, sharedLocks= ] >2012-08-06 15:28:23,088 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp--127.0.0.1-8009-10) [5fb12c0b] Running command: AddStoragePoolWithStoragesCommand internal: true. Entities affected : ID: 7a858a05-d5d9-40de-9a4e-c24b1980eb23 Type: StoragePool >2012-08-06 15:28:23,322 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-10) [5fb12c0b] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };]), log id: 3c93f7bf >2012-08-06 15:28:23,430 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-10) [5fb12c0b] FINISH, ConnectStorageServerVDSCommand, return: {b2cd73d6-cacf-402b-b327-8ec359c99001=0}, log id: 3c93f7bf >2012-08-06 15:28:23,438 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (ajp--127.0.0.1-8009-10) [5fb12c0b] START, CreateStoragePoolVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId=7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType=ISCSI, storagePoolName=scsi, masterDomainId=99bb665e-3421-4afb-bf70-d7b879c591b3, domainsIdList=[99bb665e-3421-4afb-bf70-d7b879c591b3], masterVersion=1), log id: 184d51cb >2012-08-06 15:28:47,873 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (ajp--127.0.0.1-8009-10) [5fb12c0b] FINISH, CreateStoragePoolVDSCommand, log id: 184d51cb >2012-08-06 15:28:47,891 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp--127.0.0.1-8009-10) [5fb12c0b] Lock freed to object EngineLock [exclusiveLocks= key: 7a858a05-d5d9-40de-9a4e-c24b1980eb23 value: POOL >, sharedLocks= ] >2012-08-06 15:28:47,898 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8009-10) [40ea4e31] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 15:28:47,916 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8009-10) [40ea4e31] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 15:28:47,950 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8009-10) [40ea4e31] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 15:28:47,952 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8009-10) [40ea4e31] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 3:28 PM >2012-08-06 15:28:47,983 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [40ea4e31] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };]), log id: 152dcfd4 >2012-08-06 15:28:48,093 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [40ea4e31] FINISH, ConnectStorageServerVDSCommand, return: {b2cd73d6-cacf-402b-b327-8ec359c99001=0}, log id: 152dcfd4 >2012-08-06 15:28:48,094 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8009-10) [40ea4e31] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 3:28 PM >2012-08-06 15:28:48,096 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp--127.0.0.1-8009-10) [40ea4e31] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 2747e666 >2012-08-06 15:28:48,113 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (ajp--127.0.0.1-8009-10) [18491252] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 7a858a05-d5d9-40de-9a4e-c24b1980eb23 Type: StoragePool >2012-08-06 15:28:48,228 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (ajp--127.0.0.1-8009-10) [18491252] hostFromVds::selectedVds - purple-vds3, spmStatus Unknown_Pool, storage pool scsi >2012-08-06 15:28:48,276 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (ajp--127.0.0.1-8009-10) [18491252] START, ConnectStoragePoolVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, vds_spm_id = 1, masterDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, masterVersion = 1), log id: 3808f98a >2012-08-06 15:28:50,924 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (ajp--127.0.0.1-8009-10) [18491252] FINISH, ConnectStoragePoolVDSCommand, log id: 3808f98a >2012-08-06 15:28:50,945 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (ajp--127.0.0.1-8009-10) [18491252] hostFromVds::Connected host to pool - selectedVds - purple-vds3, spmStatus Free, storage pool scsi >2012-08-06 15:28:50,974 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (ajp--127.0.0.1-8009-10) [18491252] starting spm on vds purple-vds3, storage pool scsi, prevId -1, LVER -1 >2012-08-06 15:28:50,984 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp--127.0.0.1-8009-10) [18491252] START, SpmStartVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, prevId=-1, prevLVER=-1, storagePoolFormatType=V2, recoveryMode=Manual, SCSIFencing=false), log id: 79ae7de4 >2012-08-06 15:28:51,010 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp--127.0.0.1-8009-10) [18491252] spmStart polling started: taskId = 7721ec2f-b067-4591-bcf8-ffac0d5e4b3d >2012-08-06 15:29:04,378 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-1) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 7c19d58d >2012-08-06 15:29:05,316 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-1) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290], log id: 7c19d58d >2012-08-06 15:29:13,706 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp--127.0.0.1-8009-10) [18491252] spmStart polling ended: taskId = 7721ec2f-b067-4591-bcf8-ffac0d5e4b3d task status = finished >2012-08-06 15:29:13,730 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp--127.0.0.1-8009-10) [18491252] spmStart polling ended. spm status: SPM >2012-08-06 15:29:13,732 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (ajp--127.0.0.1-8009-10) [18491252] START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=7721ec2f-b067-4591-bcf8-ffac0d5e4b3d), log id: 1857ab4a >2012-08-06 15:29:13,757 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (ajp--127.0.0.1-8009-10) [18491252] FINISH, HSMClearTaskVDSCommand, log id: 1857ab4a >2012-08-06 15:29:13,758 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp--127.0.0.1-8009-10) [18491252] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1a66b7db, log id: 79ae7de4 >2012-08-06 15:29:13,773 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (ajp--127.0.0.1-8009-10) [18491252] Initialize Irs proxy from vds: purple-vds3 >2012-08-06 15:29:13,832 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp--127.0.0.1-8009-10) [18491252] FINISH, ActivateStorageDomainVDSCommand, log id: 2747e666 >2012-08-06 15:29:13,833 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8009-10) [18491252] ActivateStorage Domain. After Activate storage domain in vds. Time:8/6/12 3:29 PM >2012-08-06 15:29:13,869 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-3-thread-49) [18491252] START, ConnectStoragePoolVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, vds_spm_id = 1, masterDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, masterVersion = 1), log id: 17083571 >2012-08-06 15:29:13,894 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-3-thread-49) [18491252] FINISH, ConnectStoragePoolVDSCommand, log id: 17083571 >2012-08-06 15:29:13,895 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8009-10) [18491252] ActivateStorage Domain. After Refresh all pools . Time:8/6/12 3:29 PM >2012-08-06 15:29:13,993 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8009-10) [18491252] ActivateStorage Domain. After change storage pool status in vds. Time:8/6/12 3:29 PM >2012-08-06 15:29:21,451 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-4) START, DiscoverSendTargetsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, connection=org.ovirt.engine.core.common.businessentities.storage_server_connections@0), log id: 333e6bdd >2012-08-06 15:29:21,667 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-4) FINISH, DiscoverSendTargetsVDSCommand, return: [org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0], log id: 333e6bdd >2012-08-06 15:29:32,905 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-3) [6a42785] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: [lion] };]), log id: 32c2e88f >2012-08-06 15:29:32,931 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-3) [6a42785] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 32c2e88f >2012-08-06 15:29:32,974 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-3) [6a42785] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-06 15:29:32,980 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-3) [6a42785] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: [lion] };]), log id: 36fbb1c3 >2012-08-06 15:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [28b7172b] Checking autorecoverable hosts >2012-08-06 15:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [28b7172b] Autorecovering 0 hosts >2012-08-06 15:30:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [28b7172b] Checking autorecoverable hosts done >2012-08-06 15:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [28b7172b] Checking autorecoverable storage domains >2012-08-06 15:30:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [28b7172b] Autorecovering 0 storage domains >2012-08-06 15:30:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [28b7172b] Checking autorecoverable storage domains done >2012-08-06 15:30:33,008 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-7) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 39ae848b >2012-08-06 15:31:33,425 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-3) [6a42785] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=465}, log id: 36fbb1c3 >2012-08-06 15:31:33,465 ERROR [org.ovirt.engine.core.bll.storage.ISCSIStorageHelper] (ajp--127.0.0.1-8009-3) [6a42785] The connection with details 00000000-0000-0000-0000-000000000000 failed because of error code 465 and error message is: failed to setup iscsi subsystem >2012-08-06 15:31:33,572 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-3) [6a42785] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2012-08-06 15:31:34,305 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-7) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290], log id: 39ae848b >2012-08-06 15:32:51,712 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp--127.0.0.1-8009-5) [50876ff8] Running command: LogoutUserCommand internal: false. >2012-08-06 15:32:58,031 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-3) Checking if user admin@internal is an admin, result true >2012-08-06 15:32:58,032 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-3) Running command: LoginAdminUserCommand internal: false. >2012-08-06 15:33:06,044 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-4) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: a70cf35 >2012-08-06 15:33:06,999 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-4) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290], log id: a70cf35 >2012-08-06 15:33:15,055 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-2) START, DiscoverSendTargetsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, connection=org.ovirt.engine.core.common.businessentities.storage_server_connections@0), log id: d913a8c >2012-08-06 15:33:15,276 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-2) FINISH, DiscoverSendTargetsVDSCommand, return: [org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0], log id: d913a8c >2012-08-06 15:33:23,414 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-6) [1e163f2c] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: [lion] };]), log id: 7872494 >2012-08-06 15:33:23,442 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-6) [1e163f2c] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 7872494 >2012-08-06 15:33:23,502 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-6) [1e163f2c] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-06 15:33:23,508 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-6) [1e163f2c] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: [lion] };]), log id: 76f95970 >2012-08-06 15:34:14,158 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-7) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 59e19c67 >2012-08-06 15:34:57,115 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-1) Checking if user admin@internal is an admin, result true >2012-08-06 15:34:57,119 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-1) Running command: LoginAdminUserCommand internal: false. >2012-08-06 15:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable hosts >2012-08-06 15:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Autorecovering 0 hosts >2012-08-06 15:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable hosts done >2012-08-06 15:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable storage domains >2012-08-06 15:35:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Autorecovering 0 storage domains >2012-08-06 15:35:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable storage domains done >2012-08-06 15:35:26,057 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-6) [1e163f2c] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=465}, log id: 76f95970 >2012-08-06 15:35:26,078 ERROR [org.ovirt.engine.core.bll.storage.ISCSIStorageHelper] (ajp--127.0.0.1-8009-6) [1e163f2c] The connection with details 00000000-0000-0000-0000-000000000000 failed because of error code 465 and error message is: failed to setup iscsi subsystem >2012-08-06 15:35:26,086 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-6) [1e163f2c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2012-08-06 15:35:26,874 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-7) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290], log id: 59e19c67 >2012-08-06 15:36:50,080 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-18) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 10a12aaa >2012-08-06 15:36:51,216 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-18) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290], log id: 10a12aaa >2012-08-06 15:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable hosts >2012-08-06 15:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Autorecovering 0 hosts >2012-08-06 15:40:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable hosts done >2012-08-06 15:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable storage domains >2012-08-06 15:40:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Autorecovering 0 storage domains >2012-08-06 15:40:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable storage domains done >2012-08-06 15:40:33,745 INFO [org.ovirt.engine.core.bll.UpdateVdsGroupCommand] (ajp--127.0.0.1-8009-22) [1cdda9e0] Running command: UpdateVdsGroupCommand internal: false. Entities affected : ID: fc11e686-dfc1-11e1-a8f6-5b4cf6aee813 Type: VdsGroups >2012-08-06 15:40:41,867 INFO [org.ovirt.engine.core.bll.storage.UpdateStoragePoolCommand] (ajp--127.0.0.1-8009-13) [425aef69] Running command: UpdateStoragePoolCommand internal: false. Entities affected : ID: 7a858a05-d5d9-40de-9a4e-c24b1980eb23 Type: StoragePool >2012-08-06 15:40:41,897 INFO [org.ovirt.engine.core.bll.storage.UpdateStoragePoolCommand] (ajp--127.0.0.1-8009-13) [425aef69] Updating storage domain 99bb665e-3421-4afb-bf70-d7b879c591b3 (type Master) to format V3 >2012-08-06 15:40:41,923 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpgradeStoragePoolVDSCommand] (ajp--127.0.0.1-8009-13) [425aef69] START, UpgradeStoragePoolVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, poolVersion = 3), log id: 7a3ca40f >2012-08-06 15:40:41,931 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpgradeStoragePoolVDSCommand] (ajp--127.0.0.1-8009-13) [425aef69] Upgrading storage pool 7a858a05-d5d9-40de-9a4e-c24b1980eb23 to version 3 >2012-08-06 15:41:05,259 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpgradeStoragePoolVDSCommand] (ajp--127.0.0.1-8009-13) [425aef69] FINISH, UpgradeStoragePoolVDSCommand, log id: 7a3ca40f >2012-08-06 15:41:27,097 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-11) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 236d0eee >2012-08-06 15:41:28,184 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-11) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290], log id: 236d0eee >2012-08-06 15:41:44,194 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-10) START, DiscoverSendTargetsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, connection=org.ovirt.engine.core.common.businessentities.storage_server_connections@0), log id: acfc0b0 >2012-08-06 15:41:44,399 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-10) FINISH, DiscoverSendTargetsVDSCommand, return: [org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0], log id: acfc0b0 >2012-08-06 15:41:50,278 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-3) [35091755] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.81 };]), log id: 97e8122 >2012-08-06 15:41:50,303 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-3) [35091755] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 97e8122 >2012-08-06 15:41:50,338 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-3) [35091755] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-06 15:41:50,344 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-3) [35091755] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.81 };]), log id: 61d38701 >2012-08-06 15:41:51,183 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-3) [35091755] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=476}, log id: 61d38701 >2012-08-06 15:41:51,192 ERROR [org.ovirt.engine.core.bll.storage.ISCSIStorageHelper] (ajp--127.0.0.1-8009-3) [35091755] The connection with details 00000000-0000-0000-0000-000000000000 failed because of error code 476 and error message is: failed to login to iscsi node due to authorization failure >2012-08-06 15:41:51,196 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-3) [35091755] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2012-08-06 15:41:51,589 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-16) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 1d1828f6 >2012-08-06 15:41:52,554 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-16) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290], log id: 1d1828f6 >2012-08-06 15:42:27,419 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-46) [2d3c55d2] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.81 };]), log id: 3f719f09 >2012-08-06 15:42:27,455 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-46) [2d3c55d2] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 3f719f09 >2012-08-06 15:42:27,487 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-46) [2d3c55d2] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-06 15:42:27,489 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-46) [2d3c55d2] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.81 };]), log id: 56989309 >2012-08-06 15:42:27,618 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-46) [2d3c55d2] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 56989309 >2012-08-06 15:42:27,887 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-20) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 663cea91 >2012-08-06 15:42:29,052 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-20) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290], log id: 663cea91 >2012-08-06 15:42:44,678 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-33) [17637d5a] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.81 };]), log id: 57efe8c >2012-08-06 15:42:44,707 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-33) [17637d5a] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 57efe8c >2012-08-06 15:42:44,765 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-33) [17637d5a] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-06 15:42:44,771 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-33) [17637d5a] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.81 };]), log id: 47634354 >2012-08-06 15:42:44,906 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-33) [17637d5a] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 47634354 >2012-08-06 15:42:45,211 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-25) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 491eea7 >2012-08-06 15:42:46,206 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-25) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290], log id: 491eea7 >2012-08-06 15:42:52,525 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-38) [409a5947] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: [lion] };]), log id: 57d85ffb >2012-08-06 15:42:52,561 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-38) [409a5947] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 57d85ffb >2012-08-06 15:42:52,593 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-38) [409a5947] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-06 15:42:52,598 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-38) [409a5947] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: [lion] };]), log id: 45e49320 >2012-08-06 15:43:07,184 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-33) DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 15:43:44,269 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-46) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 114abb3c >2012-08-06 15:43:59,090 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-27) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 2edb92a3 >2012-08-06 15:44:53,718 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-38) [409a5947] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=465}, log id: 45e49320 >2012-08-06 15:44:53,758 ERROR [org.ovirt.engine.core.bll.storage.ISCSIStorageHelper] (ajp--127.0.0.1-8009-38) [409a5947] The connection with details 00000000-0000-0000-0000-000000000000 failed because of error code 465 and error message is: failed to setup iscsi subsystem >2012-08-06 15:44:53,762 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-38) [409a5947] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2012-08-06 15:44:54,565 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-46) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290], log id: 114abb3c >2012-08-06 15:44:55,152 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-27) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290], log id: 2edb92a3 >2012-08-06 15:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Checking autorecoverable hosts >2012-08-06 15:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Autorecovering 0 hosts >2012-08-06 15:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Checking autorecoverable hosts done >2012-08-06 15:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Checking autorecoverable storage domains >2012-08-06 15:45:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Autorecovering 0 storage domains >2012-08-06 15:45:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Checking autorecoverable storage domains done >2012-08-06 15:45:14,102 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp--127.0.0.1-8009-8) [72ba8592] Running command: LogoutUserCommand internal: false. >2012-08-06 15:45:17,746 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-25) Checking if user admin@internal is an admin, result true >2012-08-06 15:45:17,747 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-25) Running command: LoginAdminUserCommand internal: false. >2012-08-06 15:49:59,998 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) Checking autorecoverable hosts >2012-08-06 15:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) Autorecovering 0 hosts >2012-08-06 15:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) Checking autorecoverable hosts done >2012-08-06 15:50:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) Checking autorecoverable storage domains >2012-08-06 15:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) Autorecovering 0 storage domains >2012-08-06 15:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) Checking autorecoverable storage domains done >2012-08-06 15:51:15,506 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-31) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 43e8ce8e >2012-08-06 15:51:16,599 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-31) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290, org.ovirt.engine.core.common.businessentities.LUNs@cd4f21d2, org.ovirt.engine.core.common.businessentities.LUNs@e1ab42d7, org.ovirt.engine.core.common.businessentities.LUNs@457e40a7], log id: 43e8ce8e >2012-08-06 15:51:31,238 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-34) START, DiscoverSendTargetsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, connection=org.ovirt.engine.core.common.businessentities.storage_server_connections@0), log id: 500cb235 >2012-08-06 15:51:31,398 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-34) FINISH, DiscoverSendTargetsVDSCommand, return: [org.ovirt.engine.core.common.businessentities.storage_server_connections@0], log id: 500cb235 >2012-08-06 15:51:46,428 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-24) [47cfe1ae] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.160.7 };]), log id: 76097542 >2012-08-06 15:51:46,458 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-24) [47cfe1ae] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 76097542 >2012-08-06 15:51:46,481 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-24) [47cfe1ae] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-06 15:51:46,487 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-24) [47cfe1ae] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.160.7 };]), log id: 4d16bdd9 >2012-08-06 15:51:47,166 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-24) [47cfe1ae] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 4d16bdd9 >2012-08-06 15:51:47,375 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-34) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 52d75cf9 >2012-08-06 15:51:48,497 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-34) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290, org.ovirt.engine.core.common.businessentities.LUNs@2730846c, org.ovirt.engine.core.common.businessentities.LUNs@a6a7f2b0, org.ovirt.engine.core.common.businessentities.LUNs@75963dbf, org.ovirt.engine.core.common.businessentities.LUNs@ed9b2cb5], log id: 52d75cf9 >2012-08-06 15:51:58,663 INFO [org.ovirt.engine.core.bll.storage.AddSANStorageDomainCommand] (ajp--127.0.0.1-8009-4) [23952bf8] Running command: AddSANStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-06 15:51:58,691 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVGVDSCommand] (ajp--127.0.0.1-8009-4) [23952bf8] START, CreateVGVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageDomainId=6eb052fb-6503-4d84-b053-62ed828dbbf2, deviceList=[3514f0c5695800155], force=false), log id: 551a3ac9 >2012-08-06 15:51:59,734 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVGVDSCommand] (ajp--127.0.0.1-8009-4) [23952bf8] FINISH, CreateVGVDSCommand, return: 4qgd9C-kGd5-lbIN-YeEE-IPsG-yq6o-O0HR94, log id: 551a3ac9 >2012-08-06 15:51:59,739 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8009-4) [23952bf8] START, CreateStorageDomainVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageDomain=org.ovirt.engine.core.common.businessentities.storage_domain_static@fcddd7, args=4qgd9C-kGd5-lbIN-YeEE-IPsG-yq6o-O0HR94), log id: 3fe008fe >2012-08-06 15:52:05,266 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8009-4) [23952bf8] FINISH, CreateStorageDomainVDSCommand, log id: 3fe008fe >2012-08-06 15:52:05,270 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp--127.0.0.1-8009-4) [23952bf8] START, GetStorageDomainStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageDomainId=6eb052fb-6503-4d84-b053-62ed828dbbf2), log id: 4dd14ac6 >2012-08-06 15:52:05,554 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp--127.0.0.1-8009-4) [23952bf8] FINISH, GetStorageDomainStatsVDSCommand, return: org.ovirt.engine.core.common.businessentities.storage_domains@b48062e1, log id: 4dd14ac6 >2012-08-06 15:52:05,594 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp--127.0.0.1-8009-4) [23952bf8] START, GetVGInfoVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, VGID=4qgd9C-kGd5-lbIN-YeEE-IPsG-yq6o-O0HR94), log id: 248f5cf6 >2012-08-06 15:52:05,647 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp--127.0.0.1-8009-4) [23952bf8] FINISH, GetVGInfoVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@b83b5df9], log id: 248f5cf6 >2012-08-06 15:52:06,163 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8009-6) [28d4527e] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 6eb052fb-6503-4d84-b053-62ed828dbbf2 Type: Storage >2012-08-06 15:52:06,242 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [28d4527e] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: b9e41089-9d8f-4cc3-aae6-086f7dff7986, connection: 10.35.160.9 };{ id: 553c0d39-82b5-40f9-8070-a98245983da8, connection: 10.35.160.7 };]), log id: 1d7541c >2012-08-06 15:52:06,467 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [28d4527e] FINISH, ConnectStorageServerVDSCommand, return: {553c0d39-82b5-40f9-8070-a98245983da8=0, b9e41089-9d8f-4cc3-aae6-086f7dff7986=0}, log id: 1d7541c >2012-08-06 15:52:06,470 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp--127.0.0.1-8009-6) [28d4527e] START, AttachStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2), log id: 3a0bcae8 >2012-08-06 15:52:32,388 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp--127.0.0.1-8009-6) [28d4527e] FINISH, AttachStorageDomainVDSCommand, log id: 3a0bcae8 >2012-08-06 15:52:32,460 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-3-thread-49) [28d4527e] START, RefreshStoragePoolVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, masterStorageDomainId=99bb665e-3421-4afb-bf70-d7b879c591b3, msterVersion=1), log id: 7c88faf4 >2012-08-06 15:52:34,725 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-3-thread-49) [28d4527e] FINISH, RefreshStoragePoolVDSCommand, log id: 7c88faf4 >2012-08-06 15:52:34,935 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (pool-3-thread-49) [28d4527e] START, DisconnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: b9e41089-9d8f-4cc3-aae6-086f7dff7986, connection: 10.35.160.9 };{ id: 553c0d39-82b5-40f9-8070-a98245983da8, connection: 10.35.160.7 };]), log id: 4cf54ac0 >2012-08-06 15:52:36,630 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (pool-3-thread-49) [28d4527e] FINISH, DisconnectStorageServerVDSCommand, return: {553c0d39-82b5-40f9-8070-a98245983da8=0, b9e41089-9d8f-4cc3-aae6-086f7dff7986=0}, log id: 4cf54ac0 >2012-08-06 15:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable hosts >2012-08-06 15:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Autorecovering 0 hosts >2012-08-06 15:55:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable hosts done >2012-08-06 15:55:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable storage domains >2012-08-06 15:55:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Autorecovering 0 storage domains >2012-08-06 15:55:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable storage domains done >2012-08-06 15:57:32,368 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8009-6) [6be06f40] Lock Acquired to object EngineLock [exclusiveLocks= key: Dafna value: VM_NAME >, sharedLocks= ] >2012-08-06 15:57:32,436 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-6) [6be06f40] START, IsValidVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1cf43a2b >2012-08-06 15:57:32,438 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-6) [6be06f40] FINISH, IsValidVDSCommand, return: true, log id: 1cf43a2b >2012-08-06 15:57:32,470 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8009-6) [6be06f40] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: fc11e686-dfc1-11e1-a8f6-5b4cf6aee813 Type: VdsGroups >2012-08-06 15:57:32,476 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-6) [6be06f40] START, IsValidVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 3d571ac0 >2012-08-06 15:57:32,482 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-6) [6be06f40] FINISH, IsValidVDSCommand, return: true, log id: 3d571ac0 >2012-08-06 15:57:32,605 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8009-6) [6be06f40] Lock freed to object EngineLock [exclusiveLocks= key: Dafna value: VM_NAME >, sharedLocks= ] >2012-08-06 15:57:35,351 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp--127.0.0.1-8009-31) [58c62bc1] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d Type: VM >2012-08-06 15:57:35,354 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp--127.0.0.1-8009-31) [58c62bc1] MacPoolManager::allocateNewMac entered >2012-08-06 15:57:35,358 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp--127.0.0.1-8009-31) [58c62bc1] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:57 >2012-08-06 15:57:41,058 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-43) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 73d119da >2012-08-06 15:57:42,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-43) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290], log id: 73d119da >2012-08-06 15:58:02,185 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8009-3) [381395ac] Lock Acquired to object EngineLock [exclusiveLocks= key: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d value: VM_DISK_BOOT >, sharedLocks= key: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d value: VM >] >2012-08-06 15:58:02,199 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-3) [381395ac] START, IsValidVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 242742a2 >2012-08-06 15:58:02,214 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-3) [381395ac] FINISH, IsValidVDSCommand, return: true, log id: 242742a2 >2012-08-06 15:58:02,259 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8009-3) [381395ac] Running command: AddDiskCommand internal: false. Entities affected : ID: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d Type: VM, ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 15:58:02,438 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp--127.0.0.1-8009-3) [65553e10] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 15:58:02,500 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp--127.0.0.1-8009-3) [65553e10] Lock freed to object EngineLock [exclusiveLocks= key: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d value: VM_DISK_BOOT >, sharedLocks= key: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d value: VM >] >2012-08-06 15:58:02,507 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp--127.0.0.1-8009-3) [65553e10] START, CreateImageVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, imageGroupId = 6e79e636-31c7-4ed0-9796-db229f62e74b, imageSizeInBytes = 1073741824, volumeFormat = RAW, newImageId = c6688923-c769-4740-ba5b-4870e0822a80, newImageDescription = ), log id: 4ebbff8a >2012-08-06 15:58:02,515 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp--127.0.0.1-8009-3) [65553e10] -- CreateImageVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 15:58:02,520 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp--127.0.0.1-8009-3) [65553e10] -- createVolume parameters: > sdUUID=99bb665e-3421-4afb-bf70-d7b879c591b3 > spUUID=7a858a05-d5d9-40de-9a4e-c24b1980eb23 > imgGUID=6e79e636-31c7-4ed0-9796-db229f62e74b > size=1,073,741,824 bytes > volFormat=RAW > volType=Preallocated > volUUID=c6688923-c769-4740-ba5b-4870e0822a80 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2012-08-06 15:58:02,813 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp--127.0.0.1-8009-3) [65553e10] FINISH, CreateImageVDSCommand, return: c6688923-c769-4740-ba5b-4870e0822a80, log id: 4ebbff8a >2012-08-06 15:58:02,838 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (ajp--127.0.0.1-8009-3) [65553e10] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 6e79e636-31c7-4ed0-9796-db229f62e74b >2012-08-06 15:58:02,843 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (ajp--127.0.0.1-8009-3) [65553e10] EntityMultiAsyncTasks::AttachTask: Attaching task 20d0c5dc-2ed0-421f-b882-6b114ff38211 to entity 6e79e636-31c7-4ed0-9796-db229f62e74b. >2012-08-06 15:58:02,853 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (ajp--127.0.0.1-8009-3) [65553e10] Adding task 20d0c5dc-2ed0-421f-b882-6b114ff38211 to DataBase >2012-08-06 15:58:02,958 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp--127.0.0.1-8009-3) [65553e10] Adding task 20d0c5dc-2ed0-421f-b882-6b114ff38211 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 15:58:03,175 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp--127.0.0.1-8009-3) [65553e10] BaseAsyncTask::StartPollingTask: Starting to poll task 20d0c5dc-2ed0-421f-b882-6b114ff38211. >2012-08-06 15:58:03,176 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (ajp--127.0.0.1-8009-3) [65553e10] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 6e79e636-31c7-4ed0-9796-db229f62e74b is AddDisk (determined by task 20d0c5dc-2ed0-421f-b882-6b114ff38211) >2012-08-06 15:58:07,913 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-37) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2012-08-06 15:58:08,223 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-37) SPMAsyncTask::PollTask: Polling task 20d0c5dc-2ed0-421f-b882-6b114ff38211 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 15:58:08,243 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-37) BaseAsyncTask::OnTaskEndSuccess: Task 20d0c5dc-2ed0-421f-b882-6b114ff38211 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 15:58:08,245 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-37) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 6e79e636-31c7-4ed0-9796-db229f62e74b has ended -> executing EndAction >2012-08-06 15:58:08,249 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-37) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 6e79e636-31c7-4ed0-9796-db229f62e74b): calling EndAction for action type AddDisk. >2012-08-06 15:58:08,254 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddDisk >2012-08-06 15:58:08,288 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-3-thread-44) [381395ac] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2012-08-06 15:58:08,314 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-44) [65553e10] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2012-08-06 15:58:08,334 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-44) [65553e10] START, GetImageInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, imageGroupId = 6e79e636-31c7-4ed0-9796-db229f62e74b, imageId = c6688923-c769-4740-ba5b-4870e0822a80), log id: 12559b63 >2012-08-06 15:58:08,816 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-44) [65553e10] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@b9a03f6b, log id: 12559b63 >2012-08-06 15:58:09,032 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-44) START, UpdateVMVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 249b821e >2012-08-06 15:58:09,100 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-44) FINISH, UpdateVMVDSCommand, log id: 249b821e >2012-08-06 15:58:09,180 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk completed, handling the result. >2012-08-06 15:58:09,181 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk succeeded, clearing tasks. >2012-08-06 15:58:09,196 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 20d0c5dc-2ed0-421f-b882-6b114ff38211 >2012-08-06 15:58:09,200 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) START, SPMClearTaskVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 20d0c5dc-2ed0-421f-b882-6b114ff38211), log id: 11c7ef05 >2012-08-06 15:58:09,207 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=20d0c5dc-2ed0-421f-b882-6b114ff38211), log id: 72b23188 >2012-08-06 15:58:09,245 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) FINISH, HSMClearTaskVDSCommand, log id: 72b23188 >2012-08-06 15:58:09,246 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) FINISH, SPMClearTaskVDSCommand, log id: 11c7ef05 >2012-08-06 15:58:09,263 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) BaseAsyncTask::RemoveTaskFromDB: Removed task 20d0c5dc-2ed0-421f-b882-6b114ff38211 from DataBase >2012-08-06 15:58:09,264 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 6e79e636-31c7-4ed0-9796-db229f62e74b >2012-08-06 15:58:10,394 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8009-31) Lock Acquired to object EngineLock [exclusiveLocks= key: 6eb052fb-6503-4d84-b053-62ed828dbbf2 value: STORAGE >, sharedLocks= ] >2012-08-06 15:58:10,593 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-44) [57a7856b] Running command: ActivateStorageDomainCommand internal: false. Entities affected : ID: 6eb052fb-6503-4d84-b053-62ed828dbbf2 Type: Storage >2012-08-06 15:58:10,622 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-44) [57a7856b] Lock freed to object EngineLock [exclusiveLocks= key: 6eb052fb-6503-4d84-b053-62ed828dbbf2 value: STORAGE >, sharedLocks= ] >2012-08-06 15:58:10,623 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-44) [57a7856b] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 3:58 PM >2012-08-06 15:58:10,652 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [57a7856b] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b9e41089-9d8f-4cc3-aae6-086f7dff7986, connection: 10.35.160.9 };{ id: 553c0d39-82b5-40f9-8070-a98245983da8, connection: 10.35.160.7 };]), log id: 2ab12fa5 >2012-08-06 15:58:12,113 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [57a7856b] FINISH, ConnectStorageServerVDSCommand, return: {553c0d39-82b5-40f9-8070-a98245983da8=0, b9e41089-9d8f-4cc3-aae6-086f7dff7986=0}, log id: 2ab12fa5 >2012-08-06 15:58:12,115 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-44) [57a7856b] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 3:58 PM >2012-08-06 15:58:12,115 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (pool-3-thread-44) [57a7856b] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2), log id: 58e61f80 >2012-08-06 15:58:14,251 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (pool-3-thread-44) [57a7856b] FINISH, ActivateStorageDomainVDSCommand, log id: 58e61f80 >2012-08-06 15:58:14,252 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-44) [57a7856b] ActivateStorage Domain. After Activate storage domain in vds. Time:8/6/12 3:58 PM >2012-08-06 15:58:14,286 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-3-thread-49) [57a7856b] START, RefreshStoragePoolVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, masterStorageDomainId=99bb665e-3421-4afb-bf70-d7b879c591b3, msterVersion=1), log id: 663f1165 >2012-08-06 15:58:16,254 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-3-thread-49) [57a7856b] FINISH, RefreshStoragePoolVDSCommand, log id: 663f1165 >2012-08-06 15:58:16,254 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (pool-3-thread-49) [57a7856b] Refreshed vds purple-vds3 in pool scsi >2012-08-06 15:58:16,255 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-44) [57a7856b] ActivateStorage Domain. After Refresh all pools . Time:8/6/12 3:58 PM >2012-08-06 15:58:16,297 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-44) [57a7856b] ActivateStorage Domain. After change storage pool status in vds. Time:8/6/12 3:58 PM >2012-08-06 15:59:17,793 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-59) Setting new tasks map. The map contains now 0 tasks >2012-08-06 15:59:17,794 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-59) Cleared all tasks of pool 7a858a05-d5d9-40de-9a4e-c24b1980eb23. >2012-08-06 15:59:17,797 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-59) Could not find vds that is spm and non-operational. >2012-08-06 16:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Checking autorecoverable hosts >2012-08-06 16:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Autorecovering 0 hosts >2012-08-06 16:00:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Checking autorecoverable hosts done >2012-08-06 16:00:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Checking autorecoverable storage domains >2012-08-06 16:00:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Autorecovering 0 storage domains >2012-08-06 16:00:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Checking autorecoverable storage domains done >2012-08-06 16:04:16,044 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8009-27) Lock Acquired to object EngineLock [exclusiveLocks= key: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d value: VM >, sharedLocks= ] >2012-08-06 16:04:16,060 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-27) START, IsValidVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 28bee38a >2012-08-06 16:04:16,061 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-27) FINISH, IsValidVDSCommand, return: true, log id: 28bee38a >2012-08-06 16:04:16,119 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-27) START, IsVmDuringInitiatingVDSCommand(vmId = ab0218a2-01e2-45f6-a234-fa9ee7e58a9d), log id: fed4e6d >2012-08-06 16:04:16,120 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-27) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: fed4e6d >2012-08-06 16:04:16,221 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) [7f35a4c4] Running command: RunVmCommand internal: false. Entities affected : ID: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d Type: VM >2012-08-06 16:04:16,253 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-49) [7f35a4c4] START, CreateVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=ab0218a2-01e2-45f6-a234-fa9ee7e58a9d, vm=org.ovirt.engine.core.common.businessentities.VM@57d36052), log id: de77967 >2012-08-06 16:04:16,259 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-49) [7f35a4c4] START, CreateVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=ab0218a2-01e2-45f6-a234-fa9ee7e58a9d, vm=org.ovirt.engine.core.common.businessentities.VM@57d36052), log id: 5cb44dfd >2012-08-06 16:04:16,342 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-49) [7f35a4c4] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=0,transparentHugePages=true,vmId=ab0218a2-01e2-45f6-a234-fa9ee7e58a9d,devices=[Ljava.util.Map;@59a6159a,acpiEnable=true,vmName=Dafna,cpuType=Conroe,custom={} >2012-08-06 16:04:16,345 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-49) [7f35a4c4] FINISH, CreateVDSCommand, log id: 5cb44dfd >2012-08-06 16:04:16,354 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-49) [7f35a4c4] IncreasePendingVms::CreateVmIncreasing vds purple-vds3 pending vcpu count, now 1. Vm: Dafna >2012-08-06 16:04:16,414 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-49) [7f35a4c4] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: de77967 >2012-08-06 16:04:16,416 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) [7f35a4c4] Lock freed to object EngineLock [exclusiveLocks= key: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d value: VM >, sharedLocks= ] >2012-08-06 16:04:19,031 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-93) [406cbd81] VM Dafna ab0218a2-01e2-45f6-a234-fa9ee7e58a9d moved from WaitForLaunch --> PoweringUp >2012-08-06 16:04:19,032 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-93) [406cbd81] START, FullListVdsCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=null, vmIds=[ab0218a2-01e2-45f6-a234-fa9ee7e58a9d]), log id: 6fee25d0 >2012-08-06 16:04:19,057 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-93) [406cbd81] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@2c3d4d7c, log id: 6fee25d0 >2012-08-06 16:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable hosts >2012-08-06 16:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Autorecovering 0 hosts >2012-08-06 16:05:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable hosts done >2012-08-06 16:05:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable storage domains >2012-08-06 16:05:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Autorecovering 0 storage domains >2012-08-06 16:05:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable storage domains done >2012-08-06 16:05:16,539 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-7) VM Dafna ab0218a2-01e2-45f6-a234-fa9ee7e58a9d moved from PoweringUp --> Up >2012-08-06 16:05:16,710 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-7) START, UpdateVdsDynamicDataVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@7dd9de42), log id: 8af391b >2012-08-06 16:05:16,758 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-7) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 8af391b >2012-08-06 16:06:03,433 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-38) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 4ef25f97 >2012-08-06 16:06:03,472 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-26) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 41b23add >2012-08-06 16:06:04,688 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-38) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290, org.ovirt.engine.core.common.businessentities.LUNs@38814fbd, org.ovirt.engine.core.common.businessentities.LUNs@7cde8d2e, org.ovirt.engine.core.common.businessentities.LUNs@62aa792, org.ovirt.engine.core.common.businessentities.LUNs@4bccd83d], log id: 4ef25f97 >2012-08-06 16:06:05,476 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-26) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290, org.ovirt.engine.core.common.businessentities.LUNs@38814fbd, org.ovirt.engine.core.common.businessentities.LUNs@7cde8d2e, org.ovirt.engine.core.common.businessentities.LUNs@62aa792, org.ovirt.engine.core.common.businessentities.LUNs@4bccd83d], log id: 41b23add >2012-08-06 16:08:54,000 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-59) domain 99bb665e-3421-4afb-bf70-d7b879c591b3 in problem. vds: purple-vds3 >2012-08-06 16:09:43,809 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-73) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:09:45,825 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-77) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:09:47,837 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-66) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:09:49,849 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-72) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:09:51,224 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-67) [13d55ad0] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 7a858a05-d5d9-40de-9a4e-c24b1980eb23 Type: StoragePool >2012-08-06 16:09:51,295 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-67) [13d55ad0] IrsBroker::Failed::GetStoragePoolInfoVDS due to: ConnectException: Connection refused >2012-08-06 16:09:51,861 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-58) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:09:53,873 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-83) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:09:55,887 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-80) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:09:57,899 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-78) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:09:59,911 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-82) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Checking autorecoverable hosts >2012-08-06 16:10:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Autorecovering 0 hosts >2012-08-06 16:10:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Checking autorecoverable hosts done >2012-08-06 16:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Checking autorecoverable storage domains >2012-08-06 16:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Autorecovering 0 storage domains >2012-08-06 16:10:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Checking autorecoverable storage domains done >2012-08-06 16:10:01,313 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) IrsBroker::Failed::GetStoragePoolInfoVDS due to: ConnectException: Connection refused >2012-08-06 16:10:01,938 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-95) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:10:03,950 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-85) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:10:05,961 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-91) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:10:07,978 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-7) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:10:09,990 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-4) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:10:11,335 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) [406cbd81] IrsBroker::Failed::GetStoragePoolInfoVDS due to: ConnectException: Connection refused >2012-08-06 16:10:12,001 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-11) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:10:14,013 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-100) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:10:16,060 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-18) [6a0b4f90] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:10:18,076 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-26) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:10:20,088 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-27) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:10:21,351 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-5) [597ec698] IrsBroker::Failed::GetStoragePoolInfoVDS due to: ConnectException: Connection refused >2012-08-06 16:10:22,109 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-28) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:10:24,121 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-23) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:10:26,139 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-32) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:10:28,152 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-43) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:10:30,164 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-64) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:10:31,376 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-51) IrsBroker::Failed::GetStoragePoolInfoVDS due to: ConnectException: Connection refused >2012-08-06 16:10:32,180 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-55) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:10:34,198 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-53) [423b10c5] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, VDS Network Error, continuing. >VDSNetworkException: >2012-08-06 16:10:36,267 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-48) Command org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand return value > org.ovirt.engine.core.vdsbroker.vdsbroker.VDSInfoReturnForXmlRpc@6e5dfad0 >2012-08-06 16:10:36,268 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-48) Vds: purple-vds3 >2012-08-06 16:10:36,269 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (QuartzScheduler_Worker-48) Command GetCapabilitiesVDS execution failed. Error: VDSRecoveringException: Recovering from crash or Initializing >2012-08-06 16:10:36,332 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-48) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3, error = Recovering from crash or Initializing, continuing. >2012-08-06 16:10:39,170 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-50) Cancelling the recovery from crash timer for VDS 47028088-dee6-11e1-bffa-2f8f15de3134 because vds started initializing >2012-08-06 16:10:39,172 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-50) [78e1c579] Running command: InitVdsOnUpCommand internal: true. >2012-08-06 16:10:39,329 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-50) [1509eb22] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 7a858a05-d5d9-40de-9a4e-c24b1980eb23 Type: StoragePool >2012-08-06 16:10:39,332 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-50) [1509eb22] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: 553c0d39-82b5-40f9-8070-a98245983da8, connection: 10.35.160.7 };{ id: b9e41089-9d8f-4cc3-aae6-086f7dff7986, connection: 10.35.160.9 };]), log id: 730e6f1a >2012-08-06 16:10:39,763 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-50) [1509eb22] FINISH, ConnectStorageServerVDSCommand, return: {b2cd73d6-cacf-402b-b327-8ec359c99001=0, 553c0d39-82b5-40f9-8070-a98245983da8=0, b9e41089-9d8f-4cc3-aae6-086f7dff7986=0}, log id: 730e6f1a >2012-08-06 16:10:39,764 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-50) [1509eb22] Host purple-vds3 storage connection was succeeded >2012-08-06 16:10:39,830 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-50) [1509eb22] START, ConnectStoragePoolVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, vds_spm_id = 1, masterDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, masterVersion = 1), log id: 4ac00b7d >2012-08-06 16:10:40,813 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-50) [1509eb22] Command org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand return value > Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusOnlyReturnForXmlRpc >mStatus Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc >mCode 304 >mMessage Cannot find master domain: 'spUUID=7a858a05-d5d9-40de-9a4e-c24b1980eb23, msdUUID=99bb665e-3421-4afb-bf70-d7b879c591b3' > > >2012-08-06 16:10:40,824 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-50) [1509eb22] Vds: purple-vds3 >2012-08-06 16:10:40,827 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (QuartzScheduler_Worker-50) [1509eb22] Command ConnectStoragePoolVDS execution failed. Exception: IRSNoMasterDomainException: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Cannot find master domain: 'spUUID=7a858a05-d5d9-40de-9a4e-c24b1980eb23, msdUUID=99bb665e-3421-4afb-bf70-d7b879c591b3' >2012-08-06 16:10:40,833 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-50) [1509eb22] FINISH, ConnectStoragePoolVDSCommand, log id: 4ac00b7d >2012-08-06 16:10:40,837 ERROR [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-50) [1509eb22] Could not connect host purple-vds3 to pool scsi >2012-08-06 16:10:40,899 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) [1509eb22] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-08-06 16:10:40,921 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-50) [468d177d] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 16:10:40,938 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-50) [5d8c68c] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-06 16:10:41,453 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) hostFromVds::selectedVds - purple-vds3, spmStatus Unknown_Pool, storage pool scsi >2012-08-06 16:10:41,478 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-73) START, ConnectStoragePoolVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, vds_spm_id = 1, masterDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, masterVersion = 1), log id: 7dadb33 >2012-08-06 16:10:42,292 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-73) Command org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand return value > Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusOnlyReturnForXmlRpc >mStatus Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc >mCode 304 >mMessage Cannot find master domain: 'spUUID=7a858a05-d5d9-40de-9a4e-c24b1980eb23, msdUUID=99bb665e-3421-4afb-bf70-d7b879c591b3' > > >2012-08-06 16:10:42,296 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-73) Vds: purple-vds3 >2012-08-06 16:10:42,298 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (QuartzScheduler_Worker-73) Command ConnectStoragePoolVDS execution failed. Exception: IRSNoMasterDomainException: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Cannot find master domain: 'spUUID=7a858a05-d5d9-40de-9a4e-c24b1980eb23, msdUUID=99bb665e-3421-4afb-bf70-d7b879c591b3' >2012-08-06 16:10:42,305 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-73) FINISH, ConnectStoragePoolVDSCommand, log id: 7dadb33 >2012-08-06 16:10:42,308 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) IrsBroker::Failed::GetStoragePoolInfoVDS >2012-08-06 16:10:42,311 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) Exception: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Cannot find master domain: 'spUUID=7a858a05-d5d9-40de-9a4e-c24b1980eb23, msdUUID=99bb665e-3421-4afb-bf70-d7b879c591b3' >2012-08-06 16:10:42,362 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (QuartzScheduler_Worker-73) [9f5a253] The message key ReconstructMasterDomain is missing from bundles/ExecutionMessages >2012-08-06 16:10:42,458 INFO [org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand] (QuartzScheduler_Worker-73) [9f5a253] Running command: ReconstructMasterDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:10:42,559 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MarkPoolInReconstructModeVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] START, MarkPoolInReconstructModeVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, reconstructMarkAction = ClearJobs), log id: 55748e2c >2012-08-06 16:10:42,569 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) [9f5a253] clear domain error-timers for pool 7a858a05-d5d9-40de-9a4e-c24b1980eb23 >2012-08-06 16:10:42,577 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MarkPoolInReconstructModeVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] FINISH, MarkPoolInReconstructModeVDSCommand, log id: 55748e2c >2012-08-06 16:10:42,582 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] START, ResetIrsVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, hostName = purple-vds3, vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, ignoreStopFailed = true), log id: 362c3e75 >2012-08-06 16:10:42,591 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] START, SpmStopVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23), log id: 826499a >2012-08-06 16:10:42,617 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] SpmStopVDSCommand::Stopping SPM on vds purple-vds3, pool id 7a858a05-d5d9-40de-9a4e-c24b1980eb23 >2012-08-06 16:10:42,645 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] FINISH, SpmStopVDSCommand, log id: 826499a >2012-08-06 16:10:42,661 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] FINISH, ResetIrsVDSCommand, log id: 362c3e75 >2012-08-06 16:10:42,665 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] START, DisconnectStoragePoolVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, vds_spm_id = 1, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 0), log id: 7459ebbf >2012-08-06 16:10:42,691 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] FINISH, DisconnectStoragePoolVDSCommand, log id: 7459ebbf >2012-08-06 16:10:42,700 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ReconstructMasterVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] Cannot perform logging: java.util.UnknownFormatConversionException: Conversion = 'i' > at java.util.Formatter$FormatSpecifier.conversion(Formatter.java:2646) [rt.jar:1.7.0_03-icedtea] > at java.util.Formatter$FormatSpecifier.<init>(Formatter.java:2675) [rt.jar:1.7.0_03-icedtea] > at java.util.Formatter.parse(Formatter.java:2528) [rt.jar:1.7.0_03-icedtea] > at java.util.Formatter.format(Formatter.java:2469) [rt.jar:1.7.0_03-icedtea] > at java.util.Formatter.format(Formatter.java:2423) [rt.jar:1.7.0_03-icedtea] > at java.lang.String.format(String.java:2845) [rt.jar:1.7.0_03-icedtea] > at org.ovirt.engine.core.common.vdscommands.ReconstructMasterVDSCommandParameters.toString(ReconstructMasterVDSCommandParameters.java:86) [engine-common.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.toString(VDSCommandBase.java:49) [engine-vdsbroker.jar:] > at java.text.MessageFormat.subformat(MessageFormat.java:1271) [rt.jar:1.7.0_03-icedtea] > at java.text.MessageFormat.format(MessageFormat.java:860) [rt.jar:1.7.0_03-icedtea] > at java.text.Format.format(Format.java:157) [rt.jar:1.7.0_03-icedtea] > at java.text.MessageFormat.format(MessageFormat.java:836) [rt.jar:1.7.0_03-icedtea] > at org.ovirt.engine.core.utils.log.Log.transform(Log.java:159) [engine-utils.jar:] > at org.ovirt.engine.core.utils.log.Log.infoFormat(Log.java:120) [engine-utils.jar:] > at org.ovirt.engine.core.utils.log.LoggedUtils.log(LoggedUtils.java:162) [engine-utils.jar:] > at org.ovirt.engine.core.utils.log.LoggedUtils.logEntry(LoggedUtils.java:80) [engine-utils.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.Execute(VdcCommandBase.java:34) [engine-dal.jar:] > at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:390) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:1322) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand.reconstructMaster(ReconstructMasterDomainCommand.java:138) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand.executeCommand(ReconstructMasterDomainCommand.java:149) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteWithoutTransaction(CommandBase.java:810) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:901) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1256) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:168) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:107) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.Execute(CommandBase.java:916) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteAction(CommandBase.java:275) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:335) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:592) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VdsEventListener.masterDomainNotOperational(VdsEventListener.java:84) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.jpa.interceptor.SBInvocationInterceptor.processInvocation(SBInvocationInterceptor.java:47) > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:51) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.ovirt.engine.core.common.businessentities.IVdsEventListener$$$view6.masterDomainNotOperational(Unknown Source) [engine-common.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand.startReconstruct(IrsBrokerCommand.java:1654) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand.ExecuteVDSCommand(IrsBrokerCommand.java:1636) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.ExecuteCommand(VDSCommandBase.java:60) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.Execute(VdcCommandBase.java:41) [engine-dal.jar:] > at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:390) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand$IrsProxyData.ProceedStoragePoolStats(IrsBrokerCommand.java:300) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand$IrsProxyData.access$200(IrsBrokerCommand.java:124) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand$IrsProxyData$1.runInTransaction(IrsBrokerCommand.java:205) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:168) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:107) [engine-utils.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand$IrsProxyData._updatingTimer_Elapsed(IrsBrokerCommand.java:195) [engine-vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor46.invoke(Unknown Source) [:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:64) [engine-scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz-2.1.2.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz-2.1.2.jar:] > >2012-08-06 16:10:47,486 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ReconstructMasterVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] FINISH, ReconstructMasterVDSCommand, log id: 4fbb69fb >2012-08-06 16:10:47,499 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] START, ConnectStoragePoolVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, vds_spm_id = 1, masterDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2, masterVersion = 2), log id: 25c51021 >2012-08-06 16:10:50,548 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] FINISH, ConnectStoragePoolVDSCommand, log id: 25c51021 >2012-08-06 16:10:50,552 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] START, RefreshStoragePoolVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, masterStorageDomainId=6eb052fb-6503-4d84-b053-62ed828dbbf2, msterVersion=2), log id: 7fe188bf >2012-08-06 16:10:52,761 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] FINISH, RefreshStoragePoolVDSCommand, log id: 7fe188bf >2012-08-06 16:10:52,875 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] START, UpdateVMVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 7eec336a >2012-08-06 16:10:52,924 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) [9f5a253] hostFromVds::selectedVds - purple-vds3, spmStatus Free, storage pool scsi >2012-08-06 16:10:52,946 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) [9f5a253] starting spm on vds purple-vds3, storage pool scsi, prevId -1, LVER -1 >2012-08-06 16:10:52,948 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] START, SpmStartVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: f8cf9ce >2012-08-06 16:10:52,979 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] spmStart polling started: taskId = 5a381bfb-c10a-4b55-ade8-ced5b4ec3668 >2012-08-06 16:11:17,586 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] spmStart polling ended: taskId = 5a381bfb-c10a-4b55-ade8-ced5b4ec3668 task status = finished >2012-08-06 16:11:17,607 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] spmStart polling ended. spm status: SPM >2012-08-06 16:11:17,609 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=5a381bfb-c10a-4b55-ade8-ced5b4ec3668), log id: 41f9debc >2012-08-06 16:11:17,632 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] FINISH, HSMClearTaskVDSCommand, log id: 41f9debc >2012-08-06 16:11:17,633 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3286eef5, log id: f8cf9ce >2012-08-06 16:11:17,644 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) [9f5a253] Initialize Irs proxy from vds: purple-vds3 >2012-08-06 16:11:17,702 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] FINISH, UpdateVMVDSCommand, log id: 7eec336a >2012-08-06 16:11:17,703 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MarkPoolInReconstructModeVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] START, MarkPoolInReconstructModeVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, reconstructMarkAction = ClearCache), log id: 5731a69a >2012-08-06 16:11:17,705 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) [9f5a253] clearing cache for problematic entities in pool 7a858a05-d5d9-40de-9a4e-c24b1980eb23 >2012-08-06 16:11:17,708 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MarkPoolInReconstructModeVDSCommand] (QuartzScheduler_Worker-73) [9f5a253] FINISH, MarkPoolInReconstructModeVDSCommand, log id: 5731a69a >2012-08-06 16:11:17,713 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-12) Attempting to get and stop tasks on storage pool scsi >2012-08-06 16:11:17,714 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-12) START, SPMGetAllTasksInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 45b0def6 >2012-08-06 16:11:17,773 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-12) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool 7a858a05-d5d9-40de-9a4e-c24b1980eb23 >2012-08-06 16:11:17,775 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-12) START, HSMGetAllTasksInfoVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134), log id: 2a417364 >2012-08-06 16:11:17,809 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-12) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 2a417364 >2012-08-06 16:11:17,810 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-12) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 45b0def6 >2012-08-06 16:11:17,811 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-12) Discovered no tasks on Storage Pool scsi >2012-08-06 16:11:17,813 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-12) START, SPMGetAllTasksInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6e0647c2 >2012-08-06 16:11:17,818 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-12) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool 7a858a05-d5d9-40de-9a4e-c24b1980eb23 >2012-08-06 16:11:17,823 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-12) START, HSMGetAllTasksInfoVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134), log id: 3b0555ae >2012-08-06 16:11:17,847 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-12) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 3b0555ae >2012-08-06 16:11:17,847 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-12) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 6e0647c2 >2012-08-06 16:11:17,848 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-12) Discovered no tasks on Storage Pool scsi >2012-08-06 16:11:20,684 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) domain 99bb665e-3421-4afb-bf70-d7b879c591b3 in problem. vds: purple-vds3 >2012-08-06 16:12:21,318 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (ajp--127.0.0.1-8009-6) Lock Acquired to object EngineLock [exclusiveLocks= key: 6e79e636-31c7-4ed0-9796-db229f62e74b value: DISK >, sharedLocks= key: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d value: VM >] >2012-08-06 16:12:21,412 WARN [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (ajp--127.0.0.1-8009-6) CanDoAction of action MoveOrCopyDisk failed. Reasons:VAR__ACTION__MOVE,VAR__TYPE__VM_DISK,ACTION_TYPE_FAILED_VM_IS_NOT_DOWN >2012-08-06 16:12:21,418 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (ajp--127.0.0.1-8009-6) Lock freed to object EngineLock [exclusiveLocks= key: 6e79e636-31c7-4ed0-9796-db229f62e74b value: DISK >, sharedLocks= key: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d value: VM >] >2012-08-06 16:13:09,866 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp--127.0.0.1-8009-3) [2a02c8c9] Running command: LogoutUserCommand internal: false. >2012-08-06 16:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Checking autorecoverable hosts >2012-08-06 16:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Autorecovering 0 hosts >2012-08-06 16:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Checking autorecoverable hosts done >2012-08-06 16:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Checking autorecoverable storage domains >2012-08-06 16:15:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Autorecovering 0 storage domains >2012-08-06 16:15:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Checking autorecoverable storage domains done >2012-08-06 16:16:20,689 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-55) starting ProcessDomainRecovery for domain 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 16:16:20,713 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-55) domain 99bb665e-3421-4afb-bf70-d7b879c591b3 was reported by all hosts in status UP as problematic. Moving the Domain to NonOperational. >2012-08-06 16:16:20,765 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (QuartzScheduler_Worker-55) [1bfcbc57] The message key HandleFailedStorageDomain is missing from bundles/ExecutionMessages >2012-08-06 16:16:20,861 INFO [org.ovirt.engine.core.bll.storage.HandleFailedStorageDomainCommand] (QuartzScheduler_Worker-55) [1bfcbc57] Running command: HandleFailedStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:16:20,921 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (QuartzScheduler_Worker-55) [1bfcbc57] Running command: DeactivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:16:20,960 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (QuartzScheduler_Worker-55) [1bfcbc57] START, DeactivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 2), log id: 35c0523b >2012-08-06 16:16:21,754 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (QuartzScheduler_Worker-55) [1bfcbc57] FINISH, DeactivateStorageDomainVDSCommand, log id: 35c0523b >2012-08-06 16:16:21,767 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (pool-3-thread-44) [1bfcbc57] After deactivate treatment vds: purple-vds3,pool scsi >2012-08-06 16:16:21,795 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-3-thread-44) [1bfcbc57] START, RefreshStoragePoolVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, masterStorageDomainId=6eb052fb-6503-4d84-b053-62ed828dbbf2, msterVersion=2), log id: 3fa10a36 >2012-08-06 16:16:23,790 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-3-thread-44) [1bfcbc57] FINISH, RefreshStoragePoolVDSCommand, log id: 3fa10a36 >2012-08-06 16:16:23,819 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (QuartzScheduler_Worker-55) [1bfcbc57] START, DisconnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };]), log id: 47dcf4a2 >2012-08-06 16:16:24,589 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (QuartzScheduler_Worker-55) [1bfcbc57] FINISH, DisconnectStorageServerVDSCommand, return: {b2cd73d6-cacf-402b-b327-8ec359c99001=0}, log id: 47dcf4a2 >2012-08-06 16:16:24,922 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-55) [1bfcbc57] No string for UNASSIGNED type. Use default Log >2012-08-06 16:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Checking autorecoverable hosts >2012-08-06 16:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Autorecovering 0 hosts >2012-08-06 16:20:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Checking autorecoverable hosts done >2012-08-06 16:20:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Checking autorecoverable storage domains >2012-08-06 16:20:00,047 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Autorecovering 1 storage domains >2012-08-06 16:20:00,048 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 16:20:00,054 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-25) [391f73ae] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 16:20:00,109 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-25) [391f73ae] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:20:00,139 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-25) [391f73ae] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 16:20:00,143 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-25) [391f73ae] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 4:20 PM >2012-08-06 16:20:00,160 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [391f73ae] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };]), log id: 4041b76 >2012-08-06 16:22:02,271 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [391f73ae] FINISH, ConnectStorageServerVDSCommand, return: {b2cd73d6-cacf-402b-b327-8ec359c99001=465}, log id: 4041b76 >2012-08-06 16:22:02,276 INFO [org.ovirt.engine.core.bll.storage.ISCSIStorageHelper] (pool-3-thread-45) [391f73ae] The lun with id fvoeyx-ccLr-gR4r-1mJ8-S2xu-a7xZ-AEYOkT was reported as problematic ! >2012-08-06 16:22:02,292 ERROR [org.ovirt.engine.core.bll.storage.ISCSIStorageHelper] (pool-3-thread-45) [391f73ae] The connection with details 10.35.64.10 failed because of error code 465 and error message is: failed to setup iscsi subsystem >2012-08-06 16:22:02,296 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-25) [391f73ae] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 4:22 PM >2012-08-06 16:22:02,298 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-25) [391f73ae] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 363467cc >2012-08-06 16:22:03,105 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-25) [391f73ae] Failed in ActivateStorageDomainVDS method >2012-08-06 16:22:03,106 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-25) [391f73ae] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 16:22:03,107 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-25) [391f73ae] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 16:22:03,116 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-25) [391f73ae] FINISH, ActivateStorageDomainVDSCommand, log id: 363467cc >2012-08-06 16:22:03,122 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-25) [391f73ae] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 16:22:03,158 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-25) [391f73ae] Command [id=23e16ff3-e0b9-489a-83b9-09348a5f6cf3]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 16:22:03,202 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) [391f73ae] Checking autorecoverable storage domains done >2012-08-06 16:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Checking autorecoverable hosts >2012-08-06 16:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Autorecovering 0 hosts >2012-08-06 16:25:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Checking autorecoverable hosts done >2012-08-06 16:25:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Checking autorecoverable storage domains >2012-08-06 16:25:00,056 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Autorecovering 1 storage domains >2012-08-06 16:25:00,056 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 16:25:00,059 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-47) [2b5eace3] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 16:25:00,119 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-47) [2b5eace3] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:25:00,147 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-47) [2b5eace3] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 16:25:00,149 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-47) [2b5eace3] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 4:25 PM >2012-08-06 16:25:00,176 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [2b5eace3] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };]), log id: 33ebdb05 >2012-08-06 16:25:41,407 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [2b5eace3] FINISH, ConnectStorageServerVDSCommand, return: {b2cd73d6-cacf-402b-b327-8ec359c99001=0}, log id: 33ebdb05 >2012-08-06 16:25:41,408 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-47) [2b5eace3] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 4:25 PM >2012-08-06 16:25:41,409 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-47) [2b5eace3] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 71c2cdf6 >2012-08-06 16:25:44,175 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-47) [2b5eace3] FINISH, ActivateStorageDomainVDSCommand, log id: 71c2cdf6 >2012-08-06 16:25:44,176 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-47) [2b5eace3] ActivateStorage Domain. After Activate storage domain in vds. Time:8/6/12 4:25 PM >2012-08-06 16:25:44,253 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-3-thread-44) [2b5eace3] START, RefreshStoragePoolVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, masterStorageDomainId=6eb052fb-6503-4d84-b053-62ed828dbbf2, msterVersion=2), log id: 5e415cd4 >2012-08-06 16:25:46,292 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-3-thread-44) [2b5eace3] FINISH, RefreshStoragePoolVDSCommand, log id: 5e415cd4 >2012-08-06 16:25:46,293 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (pool-3-thread-44) [2b5eace3] Refreshed vds purple-vds3 in pool scsi >2012-08-06 16:25:46,294 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-47) [2b5eace3] ActivateStorage Domain. After Refresh all pools . Time:8/6/12 4:25 PM >2012-08-06 16:25:46,307 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-47) [2b5eace3] ActivateStorage Domain. After change storage pool status in vds. Time:8/6/12 4:25 PM >2012-08-06 16:25:46,362 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) [2b5eace3] Checking autorecoverable storage domains done >2012-08-06 16:26:49,345 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-28) domain 99bb665e-3421-4afb-bf70-d7b879c591b3 in problem. vds: purple-vds3 >2012-08-06 16:27:47,167 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [307ed3ab] Running command: ShutdownVmCommand internal: false. Entities affected : ID: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d Type: VM >2012-08-06 16:27:47,176 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [307ed3ab] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop Dafna). >2012-08-06 16:27:47,181 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [307ed3ab] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop Dafna. >2012-08-06 16:27:47,186 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [307ed3ab] START, DestroyVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=ab0218a2-01e2-45f6-a234-fa9ee7e58a9d, force=false, secondsToWait=30, gracefully=true), log id: 5c93aa74 >2012-08-06 16:27:47,232 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [307ed3ab] START, DestroyVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=ab0218a2-01e2-45f6-a234-fa9ee7e58a9d, force=false, secondsToWait=30, gracefully=true), log id: 1bebfdab >2012-08-06 16:27:47,392 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [307ed3ab] FINISH, DestroyVDSCommand, log id: 1bebfdab >2012-08-06 16:27:47,417 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [307ed3ab] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 5c93aa74 >2012-08-06 16:27:48,983 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) [5210152a] Running command: ShutdownVmCommand internal: false. Entities affected : ID: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d Type: VM >2012-08-06 16:27:48,992 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) [5210152a] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop Dafna). >2012-08-06 16:27:49,005 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) [5210152a] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop Dafna, status is not up. Stopping instead. >2012-08-06 16:27:49,035 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-47) [700d9530] Running command: StopVmCommand internal: true. Entities affected : ID: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d Type: VM >2012-08-06 16:27:49,049 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-47) [700d9530] START, DestroyVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=ab0218a2-01e2-45f6-a234-fa9ee7e58a9d, force=false, secondsToWait=0, gracefully=false), log id: 3ebd7cfc >2012-08-06 16:27:49,137 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-47) [700d9530] START, DestroyVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=ab0218a2-01e2-45f6-a234-fa9ee7e58a9d, force=false, secondsToWait=0, gracefully=false), log id: 13b7843a >2012-08-06 16:27:49,875 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-47) [700d9530] FINISH, DestroyVDSCommand, log id: 13b7843a >2012-08-06 16:27:50,185 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-47) [700d9530] FINISH, DestroyVmVDSCommand, return: Down, log id: 3ebd7cfc >2012-08-06 16:27:59,026 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (ajp--127.0.0.1-8009-22) Lock Acquired to object EngineLock [exclusiveLocks= key: 6e79e636-31c7-4ed0-9796-db229f62e74b value: DISK >, sharedLocks= key: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d value: VM >] >2012-08-06 16:27:59,098 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (pool-3-thread-47) The message key MoveOrCopyDisk is missing from bundles/ExecutionMessages >2012-08-06 16:27:59,161 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-47) [18feaa7a] Running command: MoveOrCopyDiskCommand internal: false. Entities affected : ID: 6e79e636-31c7-4ed0-9796-db229f62e74b Type: Disk >2012-08-06 16:27:59,169 INFO [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-47) [18feaa7a] Running command: MoveOrCopyImageGroupCommand internal: true. Entities affected : ID: 6eb052fb-6503-4d84-b053-62ed828dbbf2 Type: Storage >2012-08-06 16:27:59,177 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDSCommand] (pool-3-thread-47) [18feaa7a] START, MoveImageGroupVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, imageGroupId = 6e79e636-31c7-4ed0-9796-db229f62e74b, dstDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2, vmId = 00000000-0000-0000-0000-000000000000, op = Move, postZero = false, force = false), log id: 704d3528 >2012-08-06 16:28:25,295 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-47) [18feaa7a] Failed in MoveImageGroupVDS method >2012-08-06 16:28:25,296 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-47) [18feaa7a] Error code MoveImageError and error message IRSGenericException: IRSErrorException: Failed to MoveImageGroupVDS, error = Error moving image: ('spUUID=7a858a05-d5d9-40de-9a4e-c24b1980eb23, srcDomUUID=99bb665e-3421-4afb-bf70-d7b879c591b3, dstDomUUID=6eb052fb-6503-4d84-b053-62ed828dbbf2, imgUUID=6e79e636-31c7-4ed0-9796-db229f62e74b, vmUUID=, op=2, force=false, postZero=false force=false',) >2012-08-06 16:28:25,301 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-3-thread-47) [18feaa7a] IrsBroker::Failed::MoveImageGroupVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to MoveImageGroupVDS, error = Error moving image: ('spUUID=7a858a05-d5d9-40de-9a4e-c24b1980eb23, srcDomUUID=99bb665e-3421-4afb-bf70-d7b879c591b3, dstDomUUID=6eb052fb-6503-4d84-b053-62ed828dbbf2, imgUUID=6e79e636-31c7-4ed0-9796-db229f62e74b, vmUUID=, op=2, force=false, postZero=false force=false',) >2012-08-06 16:28:25,313 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDSCommand] (pool-3-thread-47) [18feaa7a] FINISH, MoveImageGroupVDSCommand, log id: 704d3528 >2012-08-06 16:28:25,320 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-47) [18feaa7a] Command org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to MoveImageGroupVDS, error = Error moving image: ('spUUID=7a858a05-d5d9-40de-9a4e-c24b1980eb23, srcDomUUID=99bb665e-3421-4afb-bf70-d7b879c591b3, dstDomUUID=6eb052fb-6503-4d84-b053-62ed828dbbf2, imgUUID=6e79e636-31c7-4ed0-9796-db229f62e74b, vmUUID=, op=2, force=false, postZero=false force=false',) >2012-08-06 16:28:25,341 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-47) [18feaa7a] Transaction rolled-back for command: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand. >2012-08-06 16:28:25,346 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-47) [18feaa7a] Lock freed to object EngineLock [exclusiveLocks= key: 6e79e636-31c7-4ed0-9796-db229f62e74b value: DISK >, sharedLocks= key: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d value: VM >] >2012-08-06 16:29:23,137 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (ajp--127.0.0.1-8009-13) Lock Acquired to object EngineLock [exclusiveLocks= key: 6e79e636-31c7-4ed0-9796-db229f62e74b value: DISK >, sharedLocks= key: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d value: VM >] >2012-08-06 16:29:23,179 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (pool-3-thread-47) The message key MoveOrCopyDisk is missing from bundles/ExecutionMessages >2012-08-06 16:29:23,238 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-47) [3dc42249] Running command: MoveOrCopyDiskCommand internal: false. Entities affected : ID: 6e79e636-31c7-4ed0-9796-db229f62e74b Type: Disk >2012-08-06 16:29:23,244 INFO [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-47) [3dc42249] Running command: MoveOrCopyImageGroupCommand internal: true. Entities affected : ID: 6eb052fb-6503-4d84-b053-62ed828dbbf2 Type: Storage >2012-08-06 16:29:23,250 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDSCommand] (pool-3-thread-47) [3dc42249] START, MoveImageGroupVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, imageGroupId = 6e79e636-31c7-4ed0-9796-db229f62e74b, dstDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2, vmId = 00000000-0000-0000-0000-000000000000, op = Move, postZero = false, force = false), log id: 842d80d >2012-08-06 16:29:23,500 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-47) [3dc42249] Failed in MoveImageGroupVDS method >2012-08-06 16:29:23,501 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-47) [3dc42249] Error code MoveImageError and error message IRSGenericException: IRSErrorException: Failed to MoveImageGroupVDS, error = Error moving image: ('spUUID=7a858a05-d5d9-40de-9a4e-c24b1980eb23, srcDomUUID=99bb665e-3421-4afb-bf70-d7b879c591b3, dstDomUUID=6eb052fb-6503-4d84-b053-62ed828dbbf2, imgUUID=6e79e636-31c7-4ed0-9796-db229f62e74b, vmUUID=, op=2, force=false, postZero=false force=false',) >2012-08-06 16:29:23,502 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-3-thread-47) [3dc42249] IrsBroker::Failed::MoveImageGroupVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to MoveImageGroupVDS, error = Error moving image: ('spUUID=7a858a05-d5d9-40de-9a4e-c24b1980eb23, srcDomUUID=99bb665e-3421-4afb-bf70-d7b879c591b3, dstDomUUID=6eb052fb-6503-4d84-b053-62ed828dbbf2, imgUUID=6e79e636-31c7-4ed0-9796-db229f62e74b, vmUUID=, op=2, force=false, postZero=false force=false',) >2012-08-06 16:29:23,510 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDSCommand] (pool-3-thread-47) [3dc42249] FINISH, MoveImageGroupVDSCommand, log id: 842d80d >2012-08-06 16:29:23,513 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-47) [3dc42249] Command org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to MoveImageGroupVDS, error = Error moving image: ('spUUID=7a858a05-d5d9-40de-9a4e-c24b1980eb23, srcDomUUID=99bb665e-3421-4afb-bf70-d7b879c591b3, dstDomUUID=6eb052fb-6503-4d84-b053-62ed828dbbf2, imgUUID=6e79e636-31c7-4ed0-9796-db229f62e74b, vmUUID=, op=2, force=false, postZero=false force=false',) >2012-08-06 16:29:23,526 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-47) [3dc42249] Transaction rolled-back for command: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand. >2012-08-06 16:29:23,530 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-47) [3dc42249] Lock freed to object EngineLock [exclusiveLocks= key: 6e79e636-31c7-4ed0-9796-db229f62e74b value: DISK >, sharedLocks= key: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d value: VM >] >2012-08-06 16:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-77) Checking autorecoverable hosts >2012-08-06 16:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-77) Autorecovering 0 hosts >2012-08-06 16:30:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-77) Checking autorecoverable hosts done >2012-08-06 16:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-77) Checking autorecoverable storage domains >2012-08-06 16:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-77) Autorecovering 0 storage domains >2012-08-06 16:30:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-77) Checking autorecoverable storage domains done >2012-08-06 16:31:21,221 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (ajp--127.0.0.1-8009-4) Lock Acquired to object EngineLock [exclusiveLocks= key: 6e79e636-31c7-4ed0-9796-db229f62e74b value: DISK >, sharedLocks= key: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d value: VM >] >2012-08-06 16:31:21,255 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (pool-3-thread-48) The message key MoveOrCopyDisk is missing from bundles/ExecutionMessages >2012-08-06 16:31:21,322 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-48) [1a713265] Running command: MoveOrCopyDiskCommand internal: false. Entities affected : ID: 6e79e636-31c7-4ed0-9796-db229f62e74b Type: Disk >2012-08-06 16:31:21,328 INFO [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-48) [1a713265] Running command: MoveOrCopyImageGroupCommand internal: true. Entities affected : ID: 6eb052fb-6503-4d84-b053-62ed828dbbf2 Type: Storage >2012-08-06 16:31:21,332 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDSCommand] (pool-3-thread-48) [1a713265] START, MoveImageGroupVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, imageGroupId = 6e79e636-31c7-4ed0-9796-db229f62e74b, dstDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2, vmId = 00000000-0000-0000-0000-000000000000, op = Move, postZero = false, force = false), log id: 70f752d8 >2012-08-06 16:31:22,455 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDSCommand] (pool-3-thread-48) [1a713265] FINISH, MoveImageGroupVDSCommand, log id: 70f752d8 >2012-08-06 16:31:22,471 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) [1a713265] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity c6688923-c769-4740-ba5b-4870e0822a80 >2012-08-06 16:31:22,472 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [1a713265] EntityMultiAsyncTasks::AttachTask: Attaching task 775b8dd2-4871-4b90-abcd-8c5efbe6e90c to entity c6688923-c769-4740-ba5b-4870e0822a80. >2012-08-06 16:31:22,474 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-48) [1a713265] Adding task 775b8dd2-4871-4b90-abcd-8c5efbe6e90c to DataBase >2012-08-06 16:31:22,556 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-48) [1a713265] Adding task 775b8dd2-4871-4b90-abcd-8c5efbe6e90c (Parent Command MoveOrCopyDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 16:31:22,652 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-48) [1a713265] Lock freed to object EngineLock [exclusiveLocks= key: 6e79e636-31c7-4ed0-9796-db229f62e74b value: DISK >, sharedLocks= key: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d value: VM >] >2012-08-06 16:31:22,720 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) [1a713265] BaseAsyncTask::StartPollingTask: Starting to poll task 775b8dd2-4871-4b90-abcd-8c5efbe6e90c. >2012-08-06 16:31:22,720 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [1a713265] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity c6688923-c769-4740-ba5b-4870e0822a80 is MoveOrCopyDisk (determined by task 775b8dd2-4871-4b90-abcd-8c5efbe6e90c) >2012-08-06 16:31:28,320 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-97) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2012-08-06 16:31:28,350 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-97) SPMAsyncTask::PollTask: Polling task 775b8dd2-4871-4b90-abcd-8c5efbe6e90c (Parent Command MoveOrCopyDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2012-08-06 16:31:28,355 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-97) Finished polling Tasks, will poll again in 10 seconds. >2012-08-06 16:31:49,346 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) starting ProcessDomainRecovery for domain 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 16:31:49,375 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) domain 99bb665e-3421-4afb-bf70-d7b879c591b3 was reported by all hosts in status UP as problematic. Moving the Domain to NonOperational. >2012-08-06 16:31:49,404 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (QuartzScheduler_Worker-40) [15d911a8] The message key HandleFailedStorageDomain is missing from bundles/ExecutionMessages >2012-08-06 16:31:49,712 INFO [org.ovirt.engine.core.bll.storage.HandleFailedStorageDomainCommand] (QuartzScheduler_Worker-40) [15d911a8] Running command: HandleFailedStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:31:49,734 WARN [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (QuartzScheduler_Worker-40) [15d911a8] CanDoAction of action DeactivateStorageDomain failed. Reasons:VAR__TYPE__STORAGE__DOMAIN,VAR__ACTION__DEACTIVATE,ERROR_CANNOT_DEACTIVATE_DOMAIN_WITH_TASKS >2012-08-06 16:31:49,741 ERROR [org.ovirt.engine.core.bll.storage.HandleFailedStorageDomainCommand] (QuartzScheduler_Worker-40) [15d911a8] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.HandleFailedStorageDomainCommand. >2012-08-06 16:31:49,745 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-40) [15d911a8] No string for UNASSIGNED type. Use default Log >2012-08-06 16:31:56,385 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-54) [28b7172b] domain 99bb665e-3421-4afb-bf70-d7b879c591b3 in problem. vds: purple-vds3 >2012-08-06 16:31:58,436 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-77) SPMAsyncTask::PollTask: Polling task 775b8dd2-4871-4b90-abcd-8c5efbe6e90c (Parent Command MoveOrCopyDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 16:31:58,465 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-77) BaseAsyncTask::OnTaskEndSuccess: Task 775b8dd2-4871-4b90-abcd-8c5efbe6e90c (Parent Command MoveOrCopyDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 16:31:58,471 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-77) EntityAsyncTask::EndActionIfNecessary: All tasks of entity c6688923-c769-4740-ba5b-4870e0822a80 has ended -> executing EndAction >2012-08-06 16:31:58,475 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-77) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: c6688923-c769-4740-ba5b-4870e0822a80): calling EndAction for action type MoveOrCopyDisk. >2012-08-06 16:31:58,480 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction MoveOrCopyDisk >2012-08-06 16:31:58,500 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-48) Ending command successfully: org.ovirt.engine.core.bll.MoveOrCopyDiskCommand >2012-08-06 16:31:58,505 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) START, GetImageInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2, imageGroupId = 6e79e636-31c7-4ed0-9796-db229f62e74b, imageId = c6688923-c769-4740-ba5b-4870e0822a80), log id: 7c44937a >2012-08-06 16:31:58,778 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-48) FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@838d9d, log id: 7c44937a >2012-08-06 16:31:58,844 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type MoveOrCopyDisk completed, handling the result. >2012-08-06 16:31:58,845 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type MoveOrCopyDisk succeeded, clearing tasks. >2012-08-06 16:31:58,856 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 775b8dd2-4871-4b90-abcd-8c5efbe6e90c >2012-08-06 16:31:58,859 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-48) START, SPMClearTaskVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 775b8dd2-4871-4b90-abcd-8c5efbe6e90c), log id: 4846f33a >2012-08-06 16:31:58,866 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-48) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=775b8dd2-4871-4b90-abcd-8c5efbe6e90c), log id: 6c3300ec >2012-08-06 16:31:58,891 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 6c3300ec >2012-08-06 16:31:58,892 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 4846f33a >2012-08-06 16:31:58,904 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task 775b8dd2-4871-4b90-abcd-8c5efbe6e90c from DataBase >2012-08-06 16:31:58,907 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity c6688923-c769-4740-ba5b-4870e0822a80 >2012-08-06 16:32:24,187 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (ajp--127.0.0.1-8009-13) Lock Acquired to object EngineLock [exclusiveLocks= key: 6e79e636-31c7-4ed0-9796-db229f62e74b value: DISK >, sharedLocks= key: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d value: VM >] >2012-08-06 16:32:24,219 WARN [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (ajp--127.0.0.1-8009-13) CanDoAction of action MoveOrCopyDisk failed. Reasons:VAR__ACTION__MOVE,VAR__TYPE__VM_DISK,ACTION_TYPE_FAILED_DISK_SPACE_LOW >2012-08-06 16:32:24,220 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (ajp--127.0.0.1-8009-13) Lock freed to object EngineLock [exclusiveLocks= key: 6e79e636-31c7-4ed0-9796-db229f62e74b value: DISK >, sharedLocks= key: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d value: VM >] >2012-08-06 16:32:33,401 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (ajp--127.0.0.1-8009-8) Lock Acquired to object EngineLock [exclusiveLocks= key: 6e79e636-31c7-4ed0-9796-db229f62e74b value: DISK >, sharedLocks= key: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d value: VM >] >2012-08-06 16:32:33,494 WARN [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (ajp--127.0.0.1-8009-8) CanDoAction of action MoveOrCopyDisk failed. Reasons:VAR__ACTION__MOVE,VAR__TYPE__VM_DISK,ACTION_TYPE_FAILED_DISK_SPACE_LOW >2012-08-06 16:32:33,495 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (ajp--127.0.0.1-8009-8) Lock freed to object EngineLock [exclusiveLocks= key: 6e79e636-31c7-4ed0-9796-db229f62e74b value: DISK >, sharedLocks= key: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d value: VM >] >2012-08-06 16:32:51,923 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (ajp--127.0.0.1-8009-26) Lock Acquired to object EngineLock [exclusiveLocks= key: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d value: VM >, sharedLocks= ] >2012-08-06 16:32:51,997 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-26) START, IsValidVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 93348ad >2012-08-06 16:32:52,002 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-26) FINISH, IsValidVDSCommand, return: true, log id: 93348ad >2012-08-06 16:32:52,083 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-44) [22d1c2fc] Running command: RemoveVmCommand internal: false. Entities affected : ID: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d Type: VM >2012-08-06 16:32:52,090 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-44) [22d1c2fc] START, SetVmStatusVDSCommand(vmId = ab0218a2-01e2-45f6-a234-fa9ee7e58a9d, status = ImageLocked), log id: 75e2c7ef >2012-08-06 16:32:52,097 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-44) [22d1c2fc] FINISH, SetVmStatusVDSCommand, log id: 75e2c7ef >2012-08-06 16:32:52,112 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-44) [22d1c2fc] Lock freed to object EngineLock [exclusiveLocks= key: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d value: VM >, sharedLocks= ] >2012-08-06 16:32:52,117 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-44) [22d1c2fc] START, RemoveVMVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = ab0218a2-01e2-45f6-a234-fa9ee7e58a9d), log id: 35141d1a >2012-08-06 16:32:52,150 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-44) [22d1c2fc] FINISH, RemoveVMVDSCommand, log id: 35141d1a >2012-08-06 16:32:52,156 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-3-thread-44) [3b82b12f] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d Type: VM >2012-08-06 16:32:52,174 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-3-thread-44) [52003a2d] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-08-06 16:32:52,193 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-44) [52003a2d] START, DeleteImageGroupVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2, imageGroupId = 6e79e636-31c7-4ed0-9796-db229f62e74b, postZeros = false, forceDelete = false), log id: 6acaeae2 >2012-08-06 16:32:53,570 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-44) [52003a2d] FINISH, DeleteImageGroupVDSCommand, log id: 6acaeae2 >2012-08-06 16:32:53,603 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) [52003a2d] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity ab0218a2-01e2-45f6-a234-fa9ee7e58a9d >2012-08-06 16:32:53,606 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-44) [52003a2d] EntityMultiAsyncTasks::AttachTask: Attaching task 32185fa8-bd5c-4ca2-b068-a55f3418d1bf to entity ab0218a2-01e2-45f6-a234-fa9ee7e58a9d. >2012-08-06 16:32:53,614 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-44) [52003a2d] Adding task 32185fa8-bd5c-4ca2-b068-a55f3418d1bf to DataBase >2012-08-06 16:32:53,679 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-44) [52003a2d] Adding task 32185fa8-bd5c-4ca2-b068-a55f3418d1bf (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 16:32:53,878 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) [52003a2d] BaseAsyncTask::StartPollingTask: Starting to poll task 32185fa8-bd5c-4ca2-b068-a55f3418d1bf. >2012-08-06 16:32:53,881 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-44) [52003a2d] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity ab0218a2-01e2-45f6-a234-fa9ee7e58a9d is RemoveVm (determined by task 32185fa8-bd5c-4ca2-b068-a55f3418d1bf) >2012-08-06 16:32:58,499 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-50) [5d8c68c] Polling and updating Async Tasks: 2 tasks, 1 tasks to poll now >2012-08-06 16:32:58,525 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-50) [5d8c68c] SPMAsyncTask::PollTask: Polling task 32185fa8-bd5c-4ca2-b068-a55f3418d1bf (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 16:32:58,544 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-50) [5d8c68c] BaseAsyncTask::OnTaskEndSuccess: Task 32185fa8-bd5c-4ca2-b068-a55f3418d1bf (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 16:32:58,549 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-50) [5d8c68c] EntityAsyncTask::EndActionIfNecessary: All tasks of entity ab0218a2-01e2-45f6-a234-fa9ee7e58a9d has ended -> executing EndAction >2012-08-06 16:32:58,553 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-50) [5d8c68c] EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d): calling EndAction for action type RemoveVm. >2012-08-06 16:32:58,557 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) [5d8c68c] EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction RemoveVm >2012-08-06 16:32:58,591 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-44) [5d8c68c] Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2012-08-06 16:32:58,594 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-44) [5d8c68c] Lock Acquired to object EngineLock [exclusiveLocks= key: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d value: VM >, sharedLocks= ] >2012-08-06 16:32:58,608 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-44) [5d8c68c] MacPoolManager::freeMac(mac = 00:1a:4a:23:61:57) - entered >2012-08-06 16:32:58,621 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-44) [5d8c68c] Lock freed to object EngineLock [exclusiveLocks= key: ab0218a2-01e2-45f6-a234-fa9ee7e58a9d value: VM >, sharedLocks= ] >2012-08-06 16:32:58,654 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2012-08-06 16:32:58,655 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2012-08-06 16:32:58,671 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 32185fa8-bd5c-4ca2-b068-a55f3418d1bf >2012-08-06 16:32:58,694 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) START, SPMClearTaskVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 32185fa8-bd5c-4ca2-b068-a55f3418d1bf), log id: faf042a >2012-08-06 16:32:58,700 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=32185fa8-bd5c-4ca2-b068-a55f3418d1bf), log id: 7eb224bb >2012-08-06 16:32:58,738 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) FINISH, HSMClearTaskVDSCommand, log id: 7eb224bb >2012-08-06 16:32:58,739 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) FINISH, SPMClearTaskVDSCommand, log id: faf042a >2012-08-06 16:32:58,785 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) BaseAsyncTask::RemoveTaskFromDB: Removed task 32185fa8-bd5c-4ca2-b068-a55f3418d1bf from DataBase >2012-08-06 16:32:58,786 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity ab0218a2-01e2-45f6-a234-fa9ee7e58a9d >2012-08-06 16:33:11,060 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8009-4) [2fcfc8f2] Lock Acquired to object EngineLock [exclusiveLocks= key: dafna value: VM_NAME >, sharedLocks= ] >2012-08-06 16:33:11,093 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-4) [2fcfc8f2] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 344458e5 >2012-08-06 16:33:11,095 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-4) [2fcfc8f2] FINISH, IsValidVDSCommand, return: true, log id: 344458e5 >2012-08-06 16:33:11,124 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8009-4) [2fcfc8f2] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: 04182c38-dfa3-11e1-b789-5b261cb4bf0e Type: VdsGroups >2012-08-06 16:33:11,129 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-4) [2fcfc8f2] START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1e4ad776 >2012-08-06 16:33:11,134 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-4) [2fcfc8f2] FINISH, IsValidVDSCommand, return: true, log id: 1e4ad776 >2012-08-06 16:33:11,166 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8009-4) [2fcfc8f2] Lock freed to object EngineLock [exclusiveLocks= key: dafna value: VM_NAME >, sharedLocks= ] >2012-08-06 16:33:13,566 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp--127.0.0.1-8009-17) [4beba699] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 6e685bed-4cab-4ee2-86af-d2a7625ee484 Type: VM >2012-08-06 16:33:13,568 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp--127.0.0.1-8009-17) [4beba699] MacPoolManager::allocateNewMac entered >2012-08-06 16:33:13,571 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp--127.0.0.1-8009-17) [4beba699] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:57 >2012-08-06 16:33:17,820 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-1) Setting new tasks map. The map contains now 1 tasks >2012-08-06 16:33:20,828 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-25) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 3f7e0a3f >2012-08-06 16:33:22,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-25) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290, org.ovirt.engine.core.common.businessentities.LUNs@38814fbd, org.ovirt.engine.core.common.businessentities.LUNs@7cde8d2e, org.ovirt.engine.core.common.businessentities.LUNs@62aa792, org.ovirt.engine.core.common.businessentities.LUNs@4bccd83d], log id: 3f7e0a3f >2012-08-06 16:33:29,606 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8009-24) [36350aef] Lock Acquired to object EngineLock [exclusiveLocks= key: 6e685bed-4cab-4ee2-86af-d2a7625ee484 value: VM_DISK_BOOT >, sharedLocks= key: 6e685bed-4cab-4ee2-86af-d2a7625ee484 value: VM >] >2012-08-06 16:33:29,637 WARN [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8009-24) [36350aef] CanDoAction of action AddDisk failed. Reasons:VAR__ACTION__ADD,VAR__TYPE__VM_DISK,ACTION_TYPE_FAILED_STORAGE_POOL_NOT_MATCH >2012-08-06 16:33:29,640 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8009-24) [36350aef] Lock freed to object EngineLock [exclusiveLocks= key: 6e685bed-4cab-4ee2-86af-d2a7625ee484 value: VM_DISK_BOOT >, sharedLocks= key: 6e685bed-4cab-4ee2-86af-d2a7625ee484 value: VM >] >2012-08-06 16:34:17,822 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-4) Setting new tasks map. The map contains now 0 tasks >2012-08-06 16:34:17,823 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-4) Cleared all tasks of pool 7a858a05-d5d9-40de-9a4e-c24b1980eb23. >2012-08-06 16:34:17,826 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-4) Could not find vds that is spm and non-operational. >2012-08-06 16:34:34,292 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8009-8) [3343c29d] Lock Acquired to object EngineLock [exclusiveLocks= key: 6e685bed-4cab-4ee2-86af-d2a7625ee484 value: VM_DISK_BOOT >, sharedLocks= key: 6e685bed-4cab-4ee2-86af-d2a7625ee484 value: VM >] >2012-08-06 16:34:34,302 WARN [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8009-8) [3343c29d] CanDoAction of action AddDisk failed. Reasons:VAR__ACTION__ADD,VAR__TYPE__VM_DISK,ACTION_TYPE_FAILED_STORAGE_POOL_NOT_MATCH >2012-08-06 16:34:34,306 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8009-8) [3343c29d] Lock freed to object EngineLock [exclusiveLocks= key: 6e685bed-4cab-4ee2-86af-d2a7625ee484 value: VM_DISK_BOOT >, sharedLocks= key: 6e685bed-4cab-4ee2-86af-d2a7625ee484 value: VM >] >2012-08-06 16:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Checking autorecoverable hosts >2012-08-06 16:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Autorecovering 0 hosts >2012-08-06 16:35:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Checking autorecoverable hosts done >2012-08-06 16:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Checking autorecoverable storage domains >2012-08-06 16:35:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Autorecovering 0 storage domains >2012-08-06 16:35:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) Checking autorecoverable storage domains done >2012-08-06 16:35:05,837 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (ajp--127.0.0.1-8009-24) Lock Acquired to object EngineLock [exclusiveLocks= key: 6e685bed-4cab-4ee2-86af-d2a7625ee484 value: VM >, sharedLocks= ] >2012-08-06 16:35:05,884 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-24) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 3dc4c644 >2012-08-06 16:35:05,886 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-24) FINISH, IsValidVDSCommand, return: true, log id: 3dc4c644 >2012-08-06 16:35:05,965 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) [36a88cb1] Running command: RemoveVmCommand internal: false. Entities affected : ID: 6e685bed-4cab-4ee2-86af-d2a7625ee484 Type: VM >2012-08-06 16:35:05,969 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) [36a88cb1] START, SetVmStatusVDSCommand(vmId = 6e685bed-4cab-4ee2-86af-d2a7625ee484, status = ImageLocked), log id: 5db76c04 >2012-08-06 16:35:05,981 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-47) [36a88cb1] FINISH, SetVmStatusVDSCommand, log id: 5db76c04 >2012-08-06 16:35:06,023 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-3-thread-47) [36a88cb1] Lock freed to object EngineLock [exclusiveLocks= key: 6e685bed-4cab-4ee2-86af-d2a7625ee484 value: VM >, sharedLocks= ] >2012-08-06 16:35:06,025 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-47) [36a88cb1] START, RemoveVMVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = 6e685bed-4cab-4ee2-86af-d2a7625ee484), log id: 2043e104 >2012-08-06 16:35:06,062 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-3-thread-47) [36a88cb1] FINISH, RemoveVMVDSCommand, log id: 2043e104 >2012-08-06 16:35:06,066 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-47) [36a88cb1] MacPoolManager::freeMac(mac = 00:1a:4a:23:61:57) - entered >2012-08-06 16:35:19,019 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8009-34) [2571fbf9] Lock Acquired to object EngineLock [exclusiveLocks= key: dafna value: VM_NAME >, sharedLocks= ] >2012-08-06 16:35:19,098 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-34) [2571fbf9] START, IsValidVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1e84462f >2012-08-06 16:35:19,100 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-34) [2571fbf9] FINISH, IsValidVDSCommand, return: true, log id: 1e84462f >2012-08-06 16:35:19,160 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8009-34) [2571fbf9] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: fc11e686-dfc1-11e1-a8f6-5b4cf6aee813 Type: VdsGroups >2012-08-06 16:35:19,166 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-34) [2571fbf9] START, IsValidVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 11e02b84 >2012-08-06 16:35:19,172 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-34) [2571fbf9] FINISH, IsValidVDSCommand, return: true, log id: 11e02b84 >2012-08-06 16:35:19,211 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8009-34) [2571fbf9] Lock freed to object EngineLock [exclusiveLocks= key: dafna value: VM_NAME >, sharedLocks= ] >2012-08-06 16:35:21,500 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp--127.0.0.1-8009-26) [4ac70b71] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: c6f4d0f1-f440-4096-90f5-cd57524d648d Type: VM >2012-08-06 16:35:21,502 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp--127.0.0.1-8009-26) [4ac70b71] MacPoolManager::allocateNewMac entered >2012-08-06 16:35:21,505 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp--127.0.0.1-8009-26) [4ac70b71] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:23:61:57 >2012-08-06 16:35:26,049 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-22) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: a731291 >2012-08-06 16:35:27,170 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-22) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290, org.ovirt.engine.core.common.businessentities.LUNs@38814fbd, org.ovirt.engine.core.common.businessentities.LUNs@7cde8d2e, org.ovirt.engine.core.common.businessentities.LUNs@62aa792, org.ovirt.engine.core.common.businessentities.LUNs@4bccd83d], log id: a731291 >2012-08-06 16:35:28,188 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8009-17) [4d0c0b75] Lock Acquired to object EngineLock [exclusiveLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM_DISK_BOOT >, sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 16:35:28,217 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-17) [4d0c0b75] START, IsValidVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 789411a0 >2012-08-06 16:35:28,219 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-17) [4d0c0b75] FINISH, IsValidVDSCommand, return: true, log id: 789411a0 >2012-08-06 16:35:28,224 WARN [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8009-17) [4d0c0b75] CanDoAction of action AddDisk failed. Reasons:VAR__ACTION__ADD,VAR__TYPE__VM_DISK,ACTION_TYPE_FAILED_DISK_SPACE_LOW >2012-08-06 16:35:28,228 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8009-17) [4d0c0b75] Lock freed to object EngineLock [exclusiveLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM_DISK_BOOT >, sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 16:35:40,097 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-24) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 472c2284 >2012-08-06 16:35:40,134 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-26) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 692e11d5 >2012-08-06 16:35:41,442 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-24) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290, org.ovirt.engine.core.common.businessentities.LUNs@38814fbd, org.ovirt.engine.core.common.businessentities.LUNs@7cde8d2e, org.ovirt.engine.core.common.businessentities.LUNs@62aa792, org.ovirt.engine.core.common.businessentities.LUNs@4bccd83d], log id: 472c2284 >2012-08-06 16:35:41,886 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-26) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290, org.ovirt.engine.core.common.businessentities.LUNs@38814fbd, org.ovirt.engine.core.common.businessentities.LUNs@7cde8d2e, org.ovirt.engine.core.common.businessentities.LUNs@62aa792, org.ovirt.engine.core.common.businessentities.LUNs@4bccd83d], log id: 692e11d5 >2012-08-06 16:35:48,692 INFO [org.ovirt.engine.core.bll.storage.UpdateStorageDomainCommand] (ajp--127.0.0.1-8009-6) [356afbec] Running command: UpdateStorageDomainCommand internal: false. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:35:49,065 INFO [org.ovirt.engine.core.bll.storage.ConnectAllHostsToLunCommand] (ajp--127.0.0.1-8009-8) [4caf41b2] Running command: ConnectAllHostsToLunCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:35:49,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-8) [4caf41b2] START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 2a5b9347 >2012-08-06 16:35:50,251 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-8) [4caf41b2] FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290, org.ovirt.engine.core.common.businessentities.LUNs@38814fbd, org.ovirt.engine.core.common.businessentities.LUNs@7cde8d2e, org.ovirt.engine.core.common.businessentities.LUNs@62aa792, org.ovirt.engine.core.common.businessentities.LUNs@4bccd83d], log id: 2a5b9347 >2012-08-06 16:35:50,373 INFO [org.ovirt.engine.core.bll.storage.ExtendSANStorageDomainCommand] (ajp--127.0.0.1-8009-8) [4caf41b2] Running command: ExtendSANStorageDomainCommand internal: false. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:35:50,395 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ExtendStorageDomainVDSCommand] (ajp--127.0.0.1-8009-8) [4caf41b2] START, ExtendStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, deviceList = [1paikov9]), log id: 72818abc >2012-08-06 16:35:50,959 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--127.0.0.1-8009-8) [4caf41b2] Failed in ExtendStorageDomainVDS method >2012-08-06 16:35:50,960 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--127.0.0.1-8009-8) [4caf41b2] Error code PhysDevInitializationError and error message IRSGenericException: IRSErrorException: Failed to ExtendStorageDomainVDS, error = Failed to initialize physical device: ("['/dev/mapper/1paikov9']",) >2012-08-06 16:35:50,961 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (ajp--127.0.0.1-8009-8) [4caf41b2] IrsBroker::Failed::ExtendStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ExtendStorageDomainVDS, error = Failed to initialize physical device: ("['/dev/mapper/1paikov9']",) >2012-08-06 16:35:50,967 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ExtendStorageDomainVDSCommand] (ajp--127.0.0.1-8009-8) [4caf41b2] FINISH, ExtendStorageDomainVDSCommand, log id: 72818abc >2012-08-06 16:35:50,970 ERROR [org.ovirt.engine.core.bll.storage.ExtendSANStorageDomainCommand] (ajp--127.0.0.1-8009-8) [4caf41b2] Command org.ovirt.engine.core.bll.storage.ExtendSANStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ExtendStorageDomainVDS, error = Failed to initialize physical device: ("['/dev/mapper/1paikov9']",) >2012-08-06 16:35:50,980 ERROR [org.ovirt.engine.core.bll.storage.ExtendSANStorageDomainCommand] (ajp--127.0.0.1-8009-8) [4caf41b2] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ExtendSANStorageDomainCommand. >2012-08-06 16:36:00,634 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-43) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 69809d37 >2012-08-06 16:36:00,636 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-36) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 5f8d1e09 >2012-08-06 16:36:02,044 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-43) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290, org.ovirt.engine.core.common.businessentities.LUNs@38814fbd, org.ovirt.engine.core.common.businessentities.LUNs@7cde8d2e, org.ovirt.engine.core.common.businessentities.LUNs@62aa792, org.ovirt.engine.core.common.businessentities.LUNs@4bccd83d], log id: 69809d37 >2012-08-06 16:36:02,637 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-36) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290, org.ovirt.engine.core.common.businessentities.LUNs@38814fbd, org.ovirt.engine.core.common.businessentities.LUNs@7cde8d2e, org.ovirt.engine.core.common.businessentities.LUNs@62aa792, org.ovirt.engine.core.common.businessentities.LUNs@4bccd83d], log id: 5f8d1e09 >2012-08-06 16:36:16,687 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-23) START, DiscoverSendTargetsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, connection=org.ovirt.engine.core.common.businessentities.storage_server_connections@0), log id: 40e74828 >2012-08-06 16:36:17,033 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8009-23) FINISH, DiscoverSendTargetsVDSCommand, return: [org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0, org.ovirt.engine.core.common.businessentities.storage_server_connections@0], log id: 40e74828 >2012-08-06 16:36:21,846 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-22) [73c12061] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.10 };]), log id: 1aca717 >2012-08-06 16:36:21,875 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-22) [73c12061] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 1aca717 >2012-08-06 16:36:21,905 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-22) [73c12061] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-06 16:36:21,910 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-22) [73c12061] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.10 };]), log id: 502314ce >2012-08-06 16:36:22,587 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-22) [73c12061] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 502314ce >2012-08-06 16:36:24,030 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-43) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 48e8954d >2012-08-06 16:36:25,262 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-43) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290, org.ovirt.engine.core.common.businessentities.LUNs@38814fbd, org.ovirt.engine.core.common.businessentities.LUNs@7cde8d2e, org.ovirt.engine.core.common.businessentities.LUNs@62aa792, org.ovirt.engine.core.common.businessentities.LUNs@4bccd83d], log id: 48e8954d >2012-08-06 16:36:34,671 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-29) [2e64b5c1] START, ValidateStorageServerConnectionVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.10 };]), log id: 12802ba2 >2012-08-06 16:36:34,696 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--127.0.0.1-8009-29) [2e64b5c1] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 12802ba2 >2012-08-06 16:36:34,743 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8009-29) [2e64b5c1] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-08-06 16:36:34,750 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-29) [2e64b5c1] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.35.64.10 };]), log id: 63743a2f >2012-08-06 16:36:35,419 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8009-29) [2e64b5c1] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 63743a2f >2012-08-06 16:36:36,421 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-24) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 170ba81e >2012-08-06 16:36:37,722 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-24) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290, org.ovirt.engine.core.common.businessentities.LUNs@38814fbd, org.ovirt.engine.core.common.businessentities.LUNs@7cde8d2e, org.ovirt.engine.core.common.businessentities.LUNs@62aa792, org.ovirt.engine.core.common.businessentities.LUNs@4bccd83d, org.ovirt.engine.core.common.businessentities.LUNs@e95dcdfe], log id: 170ba81e >2012-08-06 16:36:45,244 INFO [org.ovirt.engine.core.bll.storage.UpdateStorageDomainCommand] (ajp--127.0.0.1-8009-13) [7a5da461] Running command: UpdateStorageDomainCommand internal: false. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:36:45,531 INFO [org.ovirt.engine.core.bll.storage.ConnectAllHostsToLunCommand] (ajp--127.0.0.1-8009-6) [4933279f] Running command: ConnectAllHostsToLunCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:36:45,549 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-6) [4933279f] START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 5a89427a >2012-08-06 16:36:47,017 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-6) [4933279f] FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290, org.ovirt.engine.core.common.businessentities.LUNs@38814fbd, org.ovirt.engine.core.common.businessentities.LUNs@7cde8d2e, org.ovirt.engine.core.common.businessentities.LUNs@62aa792, org.ovirt.engine.core.common.businessentities.LUNs@4bccd83d, org.ovirt.engine.core.common.businessentities.LUNs@e95dcdfe], log id: 5a89427a >2012-08-06 16:36:47,114 INFO [org.ovirt.engine.core.bll.storage.ExtendSANStorageDomainCommand] (ajp--127.0.0.1-8009-6) [4933279f] Running command: ExtendSANStorageDomainCommand internal: false. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:36:47,128 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ExtendStorageDomainVDSCommand] (ajp--127.0.0.1-8009-6) [4933279f] START, ExtendStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, deviceList = [1paikov28]), log id: 3f0ff3b >2012-08-06 16:36:48,829 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ExtendStorageDomainVDSCommand] (ajp--127.0.0.1-8009-6) [4933279f] FINISH, ExtendStorageDomainVDSCommand, log id: 3f0ff3b >2012-08-06 16:36:56,392 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-83) starting ProcessDomainRecovery for domain 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 16:36:56,416 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-83) domain 99bb665e-3421-4afb-bf70-d7b879c591b3 was reported by all hosts in status UP as problematic. Moving the Domain to NonOperational. >2012-08-06 16:36:56,461 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (QuartzScheduler_Worker-83) [68f0f156] The message key HandleFailedStorageDomain is missing from bundles/ExecutionMessages >2012-08-06 16:36:56,548 INFO [org.ovirt.engine.core.bll.storage.HandleFailedStorageDomainCommand] (QuartzScheduler_Worker-83) [68f0f156] Running command: HandleFailedStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:36:56,583 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (QuartzScheduler_Worker-83) [68f0f156] Running command: DeactivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:36:56,615 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (QuartzScheduler_Worker-83) [68f0f156] START, DeactivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 2), log id: e2dd4f0 >2012-08-06 16:36:57,587 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (QuartzScheduler_Worker-83) [68f0f156] FINISH, DeactivateStorageDomainVDSCommand, log id: e2dd4f0 >2012-08-06 16:36:57,599 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (pool-3-thread-47) [68f0f156] After deactivate treatment vds: purple-vds3,pool scsi >2012-08-06 16:36:57,616 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-3-thread-47) [68f0f156] START, RefreshStoragePoolVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, masterStorageDomainId=6eb052fb-6503-4d84-b053-62ed828dbbf2, msterVersion=2), log id: 67692ae6 >2012-08-06 16:36:59,578 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-3-thread-47) [68f0f156] FINISH, RefreshStoragePoolVDSCommand, log id: 67692ae6 >2012-08-06 16:36:59,600 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (QuartzScheduler_Worker-83) [68f0f156] START, DisconnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 668a6e1b >2012-08-06 16:37:01,314 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (QuartzScheduler_Worker-83) [68f0f156] FINISH, DisconnectStorageServerVDSCommand, return: {b2cd73d6-cacf-402b-b327-8ec359c99001=0, d7f70e98-f2e9-44ba-b348-a0df8451fc68=0}, log id: 668a6e1b >2012-08-06 16:37:01,366 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-83) [68f0f156] No string for UNASSIGNED type. Use default Log >2012-08-06 16:37:12,277 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8009-29) Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 16:37:12,465 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-44) [73033066] Running command: ActivateStorageDomainCommand internal: false. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:37:12,496 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-44) [73033066] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 16:37:12,497 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-44) [73033066] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 4:37 PM >2012-08-06 16:37:12,521 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [73033066] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 2181d289 >2012-08-06 16:37:13,799 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [73033066] FINISH, ConnectStorageServerVDSCommand, return: {b2cd73d6-cacf-402b-b327-8ec359c99001=0, d7f70e98-f2e9-44ba-b348-a0df8451fc68=0}, log id: 2181d289 >2012-08-06 16:37:13,800 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-44) [73033066] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 4:37 PM >2012-08-06 16:37:13,801 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (pool-3-thread-44) [73033066] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 5000876e >2012-08-06 16:37:15,853 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (pool-3-thread-44) [73033066] FINISH, ActivateStorageDomainVDSCommand, log id: 5000876e >2012-08-06 16:37:15,854 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-44) [73033066] ActivateStorage Domain. After Activate storage domain in vds. Time:8/6/12 4:37 PM >2012-08-06 16:37:15,888 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-3-thread-47) [73033066] START, RefreshStoragePoolVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, masterStorageDomainId=6eb052fb-6503-4d84-b053-62ed828dbbf2, msterVersion=2), log id: dc41089 >2012-08-06 16:37:17,941 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-3-thread-47) [73033066] FINISH, RefreshStoragePoolVDSCommand, log id: dc41089 >2012-08-06 16:37:17,942 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (pool-3-thread-47) [73033066] Refreshed vds purple-vds3 in pool scsi >2012-08-06 16:37:17,945 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-44) [73033066] ActivateStorage Domain. After Refresh all pools . Time:8/6/12 4:37 PM >2012-08-06 16:37:17,989 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-44) [73033066] ActivateStorage Domain. After change storage pool status in vds. Time:8/6/12 4:37 PM >2012-08-06 16:38:37,687 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-8) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 7d3e227 >2012-08-06 16:38:39,141 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-8) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290, org.ovirt.engine.core.common.businessentities.LUNs@38814fbd, org.ovirt.engine.core.common.businessentities.LUNs@7cde8d2e, org.ovirt.engine.core.common.businessentities.LUNs@62aa792, org.ovirt.engine.core.common.businessentities.LUNs@4bccd83d, org.ovirt.engine.core.common.businessentities.LUNs@7fd282a2], log id: 7d3e227 >2012-08-06 16:38:40,370 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8009-25) Lock Acquired to object EngineLock [exclusiveLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM_DISK_BOOT >, sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 16:38:40,403 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-25) START, IsValidVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4e128577 >2012-08-06 16:38:40,405 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-25) FINISH, IsValidVDSCommand, return: true, log id: 4e128577 >2012-08-06 16:38:40,483 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-3-thread-47) [494915af] Running command: AddDiskCommand internal: false. Entities affected : ID: c6f4d0f1-f440-4096-90f5-cd57524d648d Type: VM, ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:38:40,595 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-47) [207f1d31] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:38:40,625 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-47) [207f1d31] Lock freed to object EngineLock [exclusiveLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM_DISK_BOOT >, sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 16:38:40,631 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-47) [207f1d31] START, CreateImageVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, imageGroupId = a6c7b8a9-09d8-4af3-97eb-30563f6e33cb, imageSizeInBytes = 1073741824, volumeFormat = RAW, newImageId = dd7dce4a-6d3f-4333-8f1e-86bd6ae5b545, newImageDescription = ), log id: 29645ba3 >2012-08-06 16:38:40,639 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-47) [207f1d31] -- CreateImageVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 16:38:40,643 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-47) [207f1d31] -- createVolume parameters: > sdUUID=99bb665e-3421-4afb-bf70-d7b879c591b3 > spUUID=7a858a05-d5d9-40de-9a4e-c24b1980eb23 > imgGUID=a6c7b8a9-09d8-4af3-97eb-30563f6e33cb > size=1,073,741,824 bytes > volFormat=RAW > volType=Preallocated > volUUID=dd7dce4a-6d3f-4333-8f1e-86bd6ae5b545 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2012-08-06 16:38:41,128 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-47) [207f1d31] FINISH, CreateImageVDSCommand, return: dd7dce4a-6d3f-4333-8f1e-86bd6ae5b545, log id: 29645ba3 >2012-08-06 16:38:41,140 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) [207f1d31] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity a6c7b8a9-09d8-4af3-97eb-30563f6e33cb >2012-08-06 16:38:41,143 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-47) [207f1d31] EntityMultiAsyncTasks::AttachTask: Attaching task a2325a25-14c1-45ee-8fb3-dc8e9390390b to entity a6c7b8a9-09d8-4af3-97eb-30563f6e33cb. >2012-08-06 16:38:41,147 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-47) [207f1d31] Adding task a2325a25-14c1-45ee-8fb3-dc8e9390390b to DataBase >2012-08-06 16:38:41,209 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-47) [207f1d31] Adding task a2325a25-14c1-45ee-8fb3-dc8e9390390b (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 16:38:41,333 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) [207f1d31] BaseAsyncTask::StartPollingTask: Starting to poll task a2325a25-14c1-45ee-8fb3-dc8e9390390b. >2012-08-06 16:38:41,334 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-47) [207f1d31] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity a6c7b8a9-09d8-4af3-97eb-30563f6e33cb is AddDisk (determined by task a2325a25-14c1-45ee-8fb3-dc8e9390390b) >2012-08-06 16:38:48,571 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-59) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2012-08-06 16:38:48,597 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-59) SPMAsyncTask::PollTask: Polling task a2325a25-14c1-45ee-8fb3-dc8e9390390b (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 16:38:48,636 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-59) BaseAsyncTask::OnTaskEndSuccess: Task a2325a25-14c1-45ee-8fb3-dc8e9390390b (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 16:38:48,641 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-59) EntityAsyncTask::EndActionIfNecessary: All tasks of entity a6c7b8a9-09d8-4af3-97eb-30563f6e33cb has ended -> executing EndAction >2012-08-06 16:38:48,645 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-59) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: a6c7b8a9-09d8-4af3-97eb-30563f6e33cb): calling EndAction for action type AddDisk. >2012-08-06 16:38:48,650 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddDisk >2012-08-06 16:38:48,678 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-3-thread-44) Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2012-08-06 16:38:48,681 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-44) [207f1d31] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2012-08-06 16:38:48,690 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-44) [207f1d31] START, GetImageInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, imageGroupId = a6c7b8a9-09d8-4af3-97eb-30563f6e33cb, imageId = dd7dce4a-6d3f-4333-8f1e-86bd6ae5b545), log id: 7f1bc86d >2012-08-06 16:38:49,194 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-44) [207f1d31] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@e5d4391, log id: 7f1bc86d >2012-08-06 16:38:49,219 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-44) START, UpdateVMVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 5ed74c9b >2012-08-06 16:38:49,265 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-44) FINISH, UpdateVMVDSCommand, log id: 5ed74c9b >2012-08-06 16:38:49,350 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk completed, handling the result. >2012-08-06 16:38:49,354 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk succeeded, clearing tasks. >2012-08-06 16:38:49,389 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) SPMAsyncTask::ClearAsyncTask: Attempting to clear task a2325a25-14c1-45ee-8fb3-dc8e9390390b >2012-08-06 16:38:49,392 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) START, SPMClearTaskVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = a2325a25-14c1-45ee-8fb3-dc8e9390390b), log id: 7f0df219 >2012-08-06 16:38:49,398 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=a2325a25-14c1-45ee-8fb3-dc8e9390390b), log id: f95eb99 >2012-08-06 16:38:49,423 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) FINISH, HSMClearTaskVDSCommand, log id: f95eb99 >2012-08-06 16:38:49,424 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) FINISH, SPMClearTaskVDSCommand, log id: 7f0df219 >2012-08-06 16:38:49,578 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) BaseAsyncTask::RemoveTaskFromDB: Removed task a2325a25-14c1-45ee-8fb3-dc8e9390390b from DataBase >2012-08-06 16:38:49,582 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity a6c7b8a9-09d8-4af3-97eb-30563f6e33cb >2012-08-06 16:39:02,621 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-46) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 3b7f06ce >2012-08-06 16:39:02,637 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-3) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 1bb4c4b0 >2012-08-06 16:39:03,902 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-46) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290, org.ovirt.engine.core.common.businessentities.LUNs@38814fbd, org.ovirt.engine.core.common.businessentities.LUNs@7cde8d2e, org.ovirt.engine.core.common.businessentities.LUNs@62aa792, org.ovirt.engine.core.common.businessentities.LUNs@4bccd83d, org.ovirt.engine.core.common.businessentities.LUNs@7fd282a2], log id: 3b7f06ce >2012-08-06 16:39:04,517 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-3) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290, org.ovirt.engine.core.common.businessentities.LUNs@38814fbd, org.ovirt.engine.core.common.businessentities.LUNs@7cde8d2e, org.ovirt.engine.core.common.businessentities.LUNs@62aa792, org.ovirt.engine.core.common.businessentities.LUNs@4bccd83d, org.ovirt.engine.core.common.businessentities.LUNs@7fd282a2], log id: 1bb4c4b0 >2012-08-06 16:39:24,833 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8009-43) Lock Acquired to object EngineLock [exclusiveLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >, sharedLocks= ] >2012-08-06 16:39:24,839 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-43) START, IsValidVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 18a086d8 >2012-08-06 16:39:24,845 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-43) FINISH, IsValidVDSCommand, return: true, log id: 18a086d8 >2012-08-06 16:39:24,878 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-43) START, IsVmDuringInitiatingVDSCommand(vmId = c6f4d0f1-f440-4096-90f5-cd57524d648d), log id: 4bc8bad5 >2012-08-06 16:39:24,879 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-43) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 4bc8bad5 >2012-08-06 16:39:25,039 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-47) [71842b7a] Running command: RunVmCommand internal: false. Entities affected : ID: c6f4d0f1-f440-4096-90f5-cd57524d648d Type: VM >2012-08-06 16:39:25,073 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-47) [71842b7a] START, CreateVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c6f4d0f1-f440-4096-90f5-cd57524d648d, vm=org.ovirt.engine.core.common.businessentities.VM@6735dc78), log id: 1f42fe10 >2012-08-06 16:39:25,077 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-47) [71842b7a] START, CreateVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c6f4d0f1-f440-4096-90f5-cd57524d648d, vm=org.ovirt.engine.core.common.businessentities.VM@6735dc78), log id: 47fd838a >2012-08-06 16:39:25,167 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-47) [71842b7a] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=0,transparentHugePages=true,vmId=c6f4d0f1-f440-4096-90f5-cd57524d648d,devices=[Ljava.util.Map;@2e204aae,acpiEnable=true,vmName=dafna,cpuType=Conroe,custom={} >2012-08-06 16:39:25,169 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-47) [71842b7a] FINISH, CreateVDSCommand, log id: 47fd838a >2012-08-06 16:39:25,176 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-47) [71842b7a] IncreasePendingVms::CreateVmIncreasing vds purple-vds3 pending vcpu count, now 1. Vm: dafna >2012-08-06 16:39:25,247 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-47) [71842b7a] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 1f42fe10 >2012-08-06 16:39:25,248 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-47) [71842b7a] Lock freed to object EngineLock [exclusiveLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >, sharedLocks= ] >2012-08-06 16:39:26,790 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-23) START, FullListVdsCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=null, vmIds=[c6f4d0f1-f440-4096-90f5-cd57524d648d]), log id: 70da8d04 >2012-08-06 16:39:26,825 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-23) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@1c603b7e, log id: 70da8d04 >2012-08-06 16:39:29,043 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-36) VM dafna c6f4d0f1-f440-4096-90f5-cd57524d648d moved from WaitForLaunch --> PoweringUp >2012-08-06 16:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Checking autorecoverable hosts >2012-08-06 16:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Autorecovering 0 hosts >2012-08-06 16:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Checking autorecoverable hosts done >2012-08-06 16:40:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Checking autorecoverable storage domains >2012-08-06 16:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Autorecovering 0 storage domains >2012-08-06 16:40:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Checking autorecoverable storage domains done >2012-08-06 16:40:17,836 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-21) Setting new tasks map. The map contains now 0 tasks >2012-08-06 16:40:17,836 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-21) Cleared all tasks of pool 7a858a05-d5d9-40de-9a4e-c24b1980eb23. >2012-08-06 16:40:17,841 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-21) Could not find vds that is spm and non-operational. >2012-08-06 16:40:26,102 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-38) VM dafna c6f4d0f1-f440-4096-90f5-cd57524d648d moved from PoweringUp --> Up >2012-08-06 16:40:26,126 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-38) START, UpdateVdsDynamicDataVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@ba7bddaa), log id: 64a8b436 >2012-08-06 16:40:26,143 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-38) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 64a8b436 >2012-08-06 16:42:19,151 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-4) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 3216516f >2012-08-06 16:42:20,708 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-4) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290, org.ovirt.engine.core.common.businessentities.LUNs@38814fbd, org.ovirt.engine.core.common.businessentities.LUNs@7cde8d2e, org.ovirt.engine.core.common.businessentities.LUNs@62aa792, org.ovirt.engine.core.common.businessentities.LUNs@4bccd83d, org.ovirt.engine.core.common.businessentities.LUNs@7fd282a2], log id: 3216516f >2012-08-06 16:42:23,934 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8009-23) Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 16:42:23,970 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-23) START, IsValidVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 40dd494c >2012-08-06 16:42:23,979 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-23) FINISH, IsValidVDSCommand, return: true, log id: 40dd494c >2012-08-06 16:42:24,091 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-3-thread-48) [72cef2e1] Running command: AddDiskCommand internal: false. Entities affected : ID: c6f4d0f1-f440-4096-90f5-cd57524d648d Type: VM, ID: 6eb052fb-6503-4d84-b053-62ed828dbbf2 Type: Storage >2012-08-06 16:42:24,372 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-48) [1574e844] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 6eb052fb-6503-4d84-b053-62ed828dbbf2 Type: Storage >2012-08-06 16:42:24,556 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-48) [1574e844] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 16:42:24,560 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-48) [1574e844] START, CreateImageVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2, imageGroupId = f76ea2ad-1631-4d8c-b1a6-0e3fb26402f7, imageSizeInBytes = 1073741824, volumeFormat = RAW, newImageId = bc017f19-230a-4e68-9cb5-7a2fa13e6759, newImageDescription = ), log id: 88eabfa >2012-08-06 16:42:24,583 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-48) [1574e844] -- CreateImageVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 16:42:24,593 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-48) [1574e844] -- createVolume parameters: > sdUUID=6eb052fb-6503-4d84-b053-62ed828dbbf2 > spUUID=7a858a05-d5d9-40de-9a4e-c24b1980eb23 > imgGUID=f76ea2ad-1631-4d8c-b1a6-0e3fb26402f7 > size=1,073,741,824 bytes > volFormat=RAW > volType=Preallocated > volUUID=bc017f19-230a-4e68-9cb5-7a2fa13e6759 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2012-08-06 16:42:25,153 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-48) [1574e844] FINISH, CreateImageVDSCommand, return: bc017f19-230a-4e68-9cb5-7a2fa13e6759, log id: 88eabfa >2012-08-06 16:42:25,170 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) [1574e844] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity f76ea2ad-1631-4d8c-b1a6-0e3fb26402f7 >2012-08-06 16:42:25,171 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [1574e844] EntityMultiAsyncTasks::AttachTask: Attaching task 9470ffbd-0645-4125-9090-614c4afdf800 to entity f76ea2ad-1631-4d8c-b1a6-0e3fb26402f7. >2012-08-06 16:42:25,173 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-48) [1574e844] Adding task 9470ffbd-0645-4125-9090-614c4afdf800 to DataBase >2012-08-06 16:42:25,219 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-48) [1574e844] Adding task 9470ffbd-0645-4125-9090-614c4afdf800 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 16:42:25,337 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) [1574e844] BaseAsyncTask::StartPollingTask: Starting to poll task 9470ffbd-0645-4125-9090-614c4afdf800. >2012-08-06 16:42:25,340 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [1574e844] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity f76ea2ad-1631-4d8c-b1a6-0e3fb26402f7 is AddDisk (determined by task 9470ffbd-0645-4125-9090-614c4afdf800) >2012-08-06 16:42:28,661 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-55) [1bfcbc57] Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2012-08-06 16:42:29,054 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-55) [1bfcbc57] SPMAsyncTask::PollTask: Polling task 9470ffbd-0645-4125-9090-614c4afdf800 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 16:42:29,070 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-55) [1bfcbc57] BaseAsyncTask::OnTaskEndSuccess: Task 9470ffbd-0645-4125-9090-614c4afdf800 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 16:42:29,076 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-55) [1bfcbc57] EntityAsyncTask::EndActionIfNecessary: All tasks of entity f76ea2ad-1631-4d8c-b1a6-0e3fb26402f7 has ended -> executing EndAction >2012-08-06 16:42:29,080 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-55) [1bfcbc57] EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: f76ea2ad-1631-4d8c-b1a6-0e3fb26402f7): calling EndAction for action type AddDisk. >2012-08-06 16:42:29,084 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) [1bfcbc57] EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddDisk >2012-08-06 16:42:29,125 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-3-thread-47) [1bfcbc57] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2012-08-06 16:42:29,126 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-47) [1574e844] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2012-08-06 16:42:29,136 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-47) [1574e844] START, GetImageInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2, imageGroupId = f76ea2ad-1631-4d8c-b1a6-0e3fb26402f7, imageId = bc017f19-230a-4e68-9cb5-7a2fa13e6759), log id: 30c53580 >2012-08-06 16:42:29,667 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-47) [1574e844] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@e7d62c6b, log id: 30c53580 >2012-08-06 16:42:29,725 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-47) START, UpdateVMVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 3a86e492 >2012-08-06 16:42:29,797 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-47) FINISH, UpdateVMVDSCommand, log id: 3a86e492 >2012-08-06 16:42:29,907 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk completed, handling the result. >2012-08-06 16:42:29,908 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk succeeded, clearing tasks. >2012-08-06 16:42:29,958 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 9470ffbd-0645-4125-9090-614c4afdf800 >2012-08-06 16:42:29,959 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-47) START, SPMClearTaskVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 9470ffbd-0645-4125-9090-614c4afdf800), log id: 62337b57 >2012-08-06 16:42:29,967 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-47) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=9470ffbd-0645-4125-9090-614c4afdf800), log id: 1dc78a4b >2012-08-06 16:42:30,016 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-47) FINISH, HSMClearTaskVDSCommand, log id: 1dc78a4b >2012-08-06 16:42:30,017 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-47) FINISH, SPMClearTaskVDSCommand, log id: 62337b57 >2012-08-06 16:42:30,086 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) BaseAsyncTask::RemoveTaskFromDB: Removed task 9470ffbd-0645-4125-9090-614c4afdf800 from DataBase >2012-08-06 16:42:30,087 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity f76ea2ad-1631-4d8c-b1a6-0e3fb26402f7 >2012-08-06 16:42:36,559 INFO [org.ovirt.engine.core.bll.HotPlugDiskToVmCommand] (pool-3-thread-44) [69405347] Running command: HotPlugDiskToVmCommand internal: false. Entities affected : ID: c6f4d0f1-f440-4096-90f5-cd57524d648d Type: VM >2012-08-06 16:42:36,563 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugDiskVDSCommand] (pool-3-thread-44) [69405347] START, HotPlugDiskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c6f4d0f1-f440-4096-90f5-cd57524d648d, volumeId = f76ea2ad-1631-4d8c-b1a6-0e3fb26402f7), log id: 56101911 >2012-08-06 16:42:37,211 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugDiskVDSCommand] (pool-3-thread-44) [69405347] FINISH, HotPlugDiskVDSCommand, log id: 56101911 >2012-08-06 16:42:44,238 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-74) START, FullListVdsCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=null, vmIds=[c6f4d0f1-f440-4096-90f5-cd57524d648d]), log id: 6f9ee516 >2012-08-06 16:42:44,258 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-74) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@28d2409a, log id: 6f9ee516 >2012-08-06 16:42:44,274 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-74) VM c6f4d0f1-f440-4096-90f5-cd57524d648d managed non plugable device was removed unexpetedly from libvirt: VmId=c6f4d0f1-f440-4096-90f5-cd57524d648d,DeviceId=f76ea2ad-1631-4d8c-b1a6-0e3fb26402f7,Device=disk,Type=disk,BootOrder=0,SpecParams={},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=false,alias= >2012-08-06 16:43:07,187 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-100) DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 16:43:36,365 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-68) domain 99bb665e-3421-4afb-bf70-d7b879c591b3 in problem. vds: purple-vds3 >2012-08-06 16:43:47,847 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-82) Setting new tasks map. The map contains now 0 tasks >2012-08-06 16:43:47,848 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-82) Cleared all tasks of pool 7a858a05-d5d9-40de-9a4e-c24b1980eb23. >2012-08-06 16:43:47,855 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-82) Could not find vds that is spm and non-operational. >2012-08-06 16:44:17,538 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-28) Domain 99bb665e-3421-4afb-bf70-d7b879c591b3 recovered from problem. vds: purple-vds3 >2012-08-06 16:44:17,539 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-28) Domain 99bb665e-3421-4afb-bf70-d7b879c591b3 has recovered from problem. No active host in the DC is reporting it as problematic, so clearing the domain recovery timer. >2012-08-06 16:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) [6a0b4f90] Checking autorecoverable hosts >2012-08-06 16:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) [6a0b4f90] Autorecovering 0 hosts >2012-08-06 16:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) [6a0b4f90] Checking autorecoverable hosts done >2012-08-06 16:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) [6a0b4f90] Checking autorecoverable storage domains >2012-08-06 16:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) [6a0b4f90] Autorecovering 0 storage domains >2012-08-06 16:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) [6a0b4f90] Checking autorecoverable storage domains done >2012-08-06 16:45:59,374 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [2248adec] Running command: ShutdownVmCommand internal: false. Entities affected : ID: c6f4d0f1-f440-4096-90f5-cd57524d648d Type: VM >2012-08-06 16:45:59,376 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [2248adec] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop dafna). >2012-08-06 16:45:59,377 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [2248adec] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop dafna. >2012-08-06 16:45:59,377 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [2248adec] START, DestroyVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c6f4d0f1-f440-4096-90f5-cd57524d648d, force=false, secondsToWait=30, gracefully=true), log id: 6e69355a >2012-08-06 16:45:59,381 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [2248adec] START, DestroyVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c6f4d0f1-f440-4096-90f5-cd57524d648d, force=false, secondsToWait=30, gracefully=true), log id: 4555be2e >2012-08-06 16:45:59,516 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [2248adec] FINISH, DestroyVDSCommand, log id: 4555be2e >2012-08-06 16:45:59,586 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [2248adec] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 6e69355a >2012-08-06 16:46:01,015 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) [59d5d808] Running command: ShutdownVmCommand internal: false. Entities affected : ID: c6f4d0f1-f440-4096-90f5-cd57524d648d Type: VM >2012-08-06 16:46:01,017 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) [59d5d808] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop dafna). >2012-08-06 16:46:01,017 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) [59d5d808] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop dafna, status is not up. Stopping instead. >2012-08-06 16:46:01,028 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-47) [10698f1b] Running command: StopVmCommand internal: true. Entities affected : ID: c6f4d0f1-f440-4096-90f5-cd57524d648d Type: VM >2012-08-06 16:46:01,030 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-47) [10698f1b] START, DestroyVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c6f4d0f1-f440-4096-90f5-cd57524d648d, force=false, secondsToWait=0, gracefully=false), log id: 34c2377f >2012-08-06 16:46:01,039 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-47) [10698f1b] START, DestroyVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c6f4d0f1-f440-4096-90f5-cd57524d648d, force=false, secondsToWait=0, gracefully=false), log id: 2ef4d768 >2012-08-06 16:46:01,748 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-47) [10698f1b] FINISH, DestroyVDSCommand, log id: 2ef4d768 >2012-08-06 16:46:01,768 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-47) [10698f1b] FINISH, DestroyVmVDSCommand, return: Down, log id: 34c2377f >2012-08-06 16:46:14,492 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/6/12 4:46 PM. Start running CanDoAction for command number 1/2 (Command type: DetachDiskFromVm) >2012-08-06 16:46:14,495 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) Start time: 8/6/12 4:46 PM. Start running CanDoAction for command number 2/2 (Command type: DetachDiskFromVm) >2012-08-06 16:46:14,569 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) End time: 8/6/12 4:46 PM. Finish handling CanDoAction for command number 2/2 (Command type: DetachDiskFromVm) >2012-08-06 16:46:14,575 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/6/12 4:46 PM. Finish handling CanDoAction for command number 1/2 (Command type: DetachDiskFromVm) >2012-08-06 16:46:14,578 INFO [org.ovirt.engine.core.bll.DetachDiskFromVmCommand] (pool-3-thread-47) [33e2985d] Running command: DetachDiskFromVmCommand internal: false. Entities affected : ID: c6f4d0f1-f440-4096-90f5-cd57524d648d Type: VM >2012-08-06 16:46:14,683 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-3-thread-47) [33e2985d] No severity for USER_DETACH_DISK_FROM_VM type >2012-08-06 16:46:14,704 INFO [org.ovirt.engine.core.bll.DetachDiskFromVmCommand] (pool-3-thread-47) [2c9c6db1] Running command: DetachDiskFromVmCommand internal: false. Entities affected : ID: c6f4d0f1-f440-4096-90f5-cd57524d648d Type: VM >2012-08-06 16:46:14,793 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-3-thread-47) [2c9c6db1] No severity for USER_DETACH_DISK_FROM_VM type >2012-08-06 16:46:29,622 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) Start time: 8/6/12 4:46 PM. Start running CanDoAction for command number 1/2 (Command type: RemoveDisk) >2012-08-06 16:46:29,623 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) Start time: 8/6/12 4:46 PM. Start running CanDoAction for command number 2/2 (Command type: RemoveDisk) >2012-08-06 16:46:29,642 INFO [org.ovirt.engine.core.bll.RemoveDiskCommand] (pool-3-thread-48) Lock Acquired to object EngineLock [exclusiveLocks= key: f76ea2ad-1631-4d8c-b1a6-0e3fb26402f7 value: DISK >, sharedLocks= ] >2012-08-06 16:46:29,651 INFO [org.ovirt.engine.core.bll.RemoveDiskCommand] (pool-3-thread-44) Lock Acquired to object EngineLock [exclusiveLocks= key: a6c7b8a9-09d8-4af3-97eb-30563f6e33cb value: DISK >, sharedLocks= ] >2012-08-06 16:46:29,685 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) End time: 8/6/12 4:46 PM. Finish handling CanDoAction for command number 1/2 (Command type: RemoveDisk) >2012-08-06 16:46:29,706 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) End time: 8/6/12 4:46 PM. Finish handling CanDoAction for command number 2/2 (Command type: RemoveDisk) >2012-08-06 16:46:29,789 INFO [org.ovirt.engine.core.bll.RemoveDiskCommand] (pool-3-thread-48) [30620c53] Running command: RemoveDiskCommand internal: false. Entities affected : ID: a6c7b8a9-09d8-4af3-97eb-30563f6e33cb Type: Disk >2012-08-06 16:46:29,818 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-3-thread-48) [107c8da3] Running command: RemoveImageCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:46:29,865 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-3-thread-48) [107c8da3] Lock freed to object EngineLock [exclusiveLocks= key: a6c7b8a9-09d8-4af3-97eb-30563f6e33cb value: DISK >, sharedLocks= ] >2012-08-06 16:46:29,867 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-48) [107c8da3] START, DeleteImageGroupVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, imageGroupId = a6c7b8a9-09d8-4af3-97eb-30563f6e33cb, postZeros = false, forceDelete = false), log id: 4a2a0d65 >2012-08-06 16:46:31,315 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-48) [107c8da3] FINISH, DeleteImageGroupVDSCommand, log id: 4a2a0d65 >2012-08-06 16:46:31,339 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) [107c8da3] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity a6c7b8a9-09d8-4af3-97eb-30563f6e33cb >2012-08-06 16:46:31,340 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [107c8da3] EntityMultiAsyncTasks::AttachTask: Attaching task 7f5057de-ce28-4c09-9b25-173d8f5621fe to entity a6c7b8a9-09d8-4af3-97eb-30563f6e33cb. >2012-08-06 16:46:31,341 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-48) [107c8da3] Adding task 7f5057de-ce28-4c09-9b25-173d8f5621fe to DataBase >2012-08-06 16:46:31,371 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-48) [107c8da3] Adding task 7f5057de-ce28-4c09-9b25-173d8f5621fe (Parent Command RemoveDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 16:46:31,445 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) [107c8da3] BaseAsyncTask::StartPollingTask: Starting to poll task 7f5057de-ce28-4c09-9b25-173d8f5621fe. >2012-08-06 16:46:31,446 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [107c8da3] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity a6c7b8a9-09d8-4af3-97eb-30563f6e33cb is RemoveDisk (determined by task 7f5057de-ce28-4c09-9b25-173d8f5621fe) >2012-08-06 16:46:31,524 INFO [org.ovirt.engine.core.bll.RemoveDiskCommand] (pool-3-thread-48) [3a31ad26] Running command: RemoveDiskCommand internal: false. Entities affected : ID: f76ea2ad-1631-4d8c-b1a6-0e3fb26402f7 Type: Disk >2012-08-06 16:46:31,536 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-3-thread-48) [44479394] Running command: RemoveImageCommand internal: true. Entities affected : ID: 6eb052fb-6503-4d84-b053-62ed828dbbf2 Type: Storage >2012-08-06 16:46:31,547 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-3-thread-48) [44479394] Lock freed to object EngineLock [exclusiveLocks= key: f76ea2ad-1631-4d8c-b1a6-0e3fb26402f7 value: DISK >, sharedLocks= ] >2012-08-06 16:46:31,549 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-48) [44479394] START, DeleteImageGroupVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2, imageGroupId = f76ea2ad-1631-4d8c-b1a6-0e3fb26402f7, postZeros = false, forceDelete = false), log id: 7d06090c >2012-08-06 16:46:32,983 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-3-thread-48) [44479394] FINISH, DeleteImageGroupVDSCommand, log id: 7d06090c >2012-08-06 16:46:33,000 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-48) [44479394] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity f76ea2ad-1631-4d8c-b1a6-0e3fb26402f7 >2012-08-06 16:46:33,000 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [44479394] EntityMultiAsyncTasks::AttachTask: Attaching task ed2b4ccb-ccd0-44db-9395-af7573a8bafc to entity f76ea2ad-1631-4d8c-b1a6-0e3fb26402f7. >2012-08-06 16:46:33,002 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-48) [44479394] Adding task ed2b4ccb-ccd0-44db-9395-af7573a8bafc to DataBase >2012-08-06 16:46:33,075 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-48) [44479394] Adding task ed2b4ccb-ccd0-44db-9395-af7573a8bafc (Parent Command RemoveDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 16:46:33,168 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-48) [44479394] BaseAsyncTask::StartPollingTask: Starting to poll task ed2b4ccb-ccd0-44db-9395-af7573a8bafc. >2012-08-06 16:46:33,169 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-48) [44479394] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity f76ea2ad-1631-4d8c-b1a6-0e3fb26402f7 is RemoveDisk (determined by task ed2b4ccb-ccd0-44db-9395-af7573a8bafc) >2012-08-06 16:46:37,929 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-29) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 7ed0d2c6 >2012-08-06 16:46:39,100 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-75) Polling and updating Async Tasks: 2 tasks, 2 tasks to poll now >2012-08-06 16:46:39,129 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-75) SPMAsyncTask::PollTask: Polling task ed2b4ccb-ccd0-44db-9395-af7573a8bafc (Parent Command RemoveDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 16:46:39,176 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-75) BaseAsyncTask::OnTaskEndSuccess: Task ed2b4ccb-ccd0-44db-9395-af7573a8bafc (Parent Command RemoveDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 16:46:39,177 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-75) EntityAsyncTask::EndActionIfNecessary: All tasks of entity f76ea2ad-1631-4d8c-b1a6-0e3fb26402f7 has ended -> executing EndAction >2012-08-06 16:46:39,178 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-75) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: f76ea2ad-1631-4d8c-b1a6-0e3fb26402f7): calling EndAction for action type RemoveDisk. >2012-08-06 16:46:39,181 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction RemoveDisk >2012-08-06 16:46:39,188 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-75) SPMAsyncTask::PollTask: Polling task 7f5057de-ce28-4c09-9b25-173d8f5621fe (Parent Command RemoveDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 16:46:39,210 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-75) BaseAsyncTask::OnTaskEndSuccess: Task 7f5057de-ce28-4c09-9b25-173d8f5621fe (Parent Command RemoveDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 16:46:39,211 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-75) EntityAsyncTask::EndActionIfNecessary: All tasks of entity a6c7b8a9-09d8-4af3-97eb-30563f6e33cb has ended -> executing EndAction >2012-08-06 16:46:39,212 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-75) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: a6c7b8a9-09d8-4af3-97eb-30563f6e33cb): calling EndAction for action type RemoveDisk. >2012-08-06 16:46:39,212 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction RemoveDisk >2012-08-06 16:46:39,287 INFO [org.ovirt.engine.core.bll.RemoveDiskCommand] (pool-3-thread-47) Ending command successfully: org.ovirt.engine.core.bll.RemoveDiskCommand >2012-08-06 16:46:39,329 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-3-thread-47) [44479394] Ending command successfully: org.ovirt.engine.core.bll.RemoveImageCommand >2012-08-06 16:46:39,349 INFO [org.ovirt.engine.core.bll.RemoveDiskCommand] (pool-3-thread-44) Ending command successfully: org.ovirt.engine.core.bll.RemoveDiskCommand >2012-08-06 16:46:39,357 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-29) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290, org.ovirt.engine.core.common.businessentities.LUNs@38814fbd, org.ovirt.engine.core.common.businessentities.LUNs@7cde8d2e, org.ovirt.engine.core.common.businessentities.LUNs@62aa792, org.ovirt.engine.core.common.businessentities.LUNs@4bccd83d, org.ovirt.engine.core.common.businessentities.LUNs@7fd282a2], log id: 7ed0d2c6 >2012-08-06 16:46:39,384 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-3-thread-44) [107c8da3] Ending command successfully: org.ovirt.engine.core.bll.RemoveImageCommand >2012-08-06 16:46:39,646 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-47) START, UpdateVMVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 0), log id: 4f87530d >2012-08-06 16:46:39,671 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-47) FINISH, UpdateVMVDSCommand, log id: 4f87530d >2012-08-06 16:46:39,793 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveDisk completed, handling the result. >2012-08-06 16:46:39,794 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveDisk succeeded, clearing tasks. >2012-08-06 16:46:39,853 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) SPMAsyncTask::ClearAsyncTask: Attempting to clear task ed2b4ccb-ccd0-44db-9395-af7573a8bafc >2012-08-06 16:46:39,854 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-47) START, SPMClearTaskVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = ed2b4ccb-ccd0-44db-9395-af7573a8bafc), log id: f7357ba >2012-08-06 16:46:39,856 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-44) START, UpdateVMVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 0), log id: 22a13ad6 >2012-08-06 16:46:39,857 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-47) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=ed2b4ccb-ccd0-44db-9395-af7573a8bafc), log id: 348efc51 >2012-08-06 16:46:39,879 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-47) FINISH, HSMClearTaskVDSCommand, log id: 348efc51 >2012-08-06 16:46:39,880 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-47) FINISH, SPMClearTaskVDSCommand, log id: f7357ba >2012-08-06 16:46:39,900 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) BaseAsyncTask::RemoveTaskFromDB: Removed task ed2b4ccb-ccd0-44db-9395-af7573a8bafc from DataBase >2012-08-06 16:46:39,901 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity f76ea2ad-1631-4d8c-b1a6-0e3fb26402f7 >2012-08-06 16:46:39,904 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-44) FINISH, UpdateVMVDSCommand, log id: 22a13ad6 >2012-08-06 16:46:39,924 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveDisk completed, handling the result. >2012-08-06 16:46:39,925 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveDisk succeeded, clearing tasks. >2012-08-06 16:46:39,955 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 7f5057de-ce28-4c09-9b25-173d8f5621fe >2012-08-06 16:46:39,956 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) START, SPMClearTaskVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 7f5057de-ce28-4c09-9b25-173d8f5621fe), log id: 2bb2e699 >2012-08-06 16:46:39,959 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=7f5057de-ce28-4c09-9b25-173d8f5621fe), log id: 5660e0b8 >2012-08-06 16:46:39,981 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) FINISH, HSMClearTaskVDSCommand, log id: 5660e0b8 >2012-08-06 16:46:39,982 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) FINISH, SPMClearTaskVDSCommand, log id: 2bb2e699 >2012-08-06 16:46:40,011 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) BaseAsyncTask::RemoveTaskFromDB: Removed task 7f5057de-ce28-4c09-9b25-173d8f5621fe from DataBase >2012-08-06 16:46:40,013 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity a6c7b8a9-09d8-4af3-97eb-30563f6e33cb >2012-08-06 16:46:48,128 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8009-16) Lock Acquired to object EngineLock [exclusiveLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM_DISK_BOOT >, sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 16:46:48,165 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-16) START, IsValidVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 72c8ac69 >2012-08-06 16:46:48,171 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-16) FINISH, IsValidVDSCommand, return: true, log id: 72c8ac69 >2012-08-06 16:46:48,249 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-3-thread-45) [2efd0bc1] Running command: AddDiskCommand internal: false. Entities affected : ID: c6f4d0f1-f440-4096-90f5-cd57524d648d Type: VM, ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:46:48,447 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-45) [44e5640a] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:46:48,472 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-45) [44e5640a] Lock freed to object EngineLock [exclusiveLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM_DISK_BOOT >, sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 16:46:48,474 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-45) [44e5640a] START, CreateImageVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, imageGroupId = fbf4b601-4a1f-4f61-aea6-a939b6287dce, imageSizeInBytes = 5368709120, volumeFormat = RAW, newImageId = be99ddfd-e771-4322-a713-a67964393fb9, newImageDescription = ), log id: 4d80ff03 >2012-08-06 16:46:48,475 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-45) [44e5640a] -- CreateImageVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 16:46:48,476 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-45) [44e5640a] -- createVolume parameters: > sdUUID=99bb665e-3421-4afb-bf70-d7b879c591b3 > spUUID=7a858a05-d5d9-40de-9a4e-c24b1980eb23 > imgGUID=fbf4b601-4a1f-4f61-aea6-a939b6287dce > size=5,368,709,120 bytes > volFormat=RAW > volType=Preallocated > volUUID=be99ddfd-e771-4322-a713-a67964393fb9 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2012-08-06 16:46:48,756 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-45) [44e5640a] FINISH, CreateImageVDSCommand, return: be99ddfd-e771-4322-a713-a67964393fb9, log id: 4d80ff03 >2012-08-06 16:46:48,779 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-45) [44e5640a] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity fbf4b601-4a1f-4f61-aea6-a939b6287dce >2012-08-06 16:46:48,780 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-45) [44e5640a] EntityMultiAsyncTasks::AttachTask: Attaching task a00f6aec-9d57-46db-a066-469d45132b57 to entity fbf4b601-4a1f-4f61-aea6-a939b6287dce. >2012-08-06 16:46:48,781 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-45) [44e5640a] Adding task a00f6aec-9d57-46db-a066-469d45132b57 to DataBase >2012-08-06 16:46:48,828 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-45) [44e5640a] Adding task a00f6aec-9d57-46db-a066-469d45132b57 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 16:46:48,994 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-45) [44e5640a] BaseAsyncTask::StartPollingTask: Starting to poll task a00f6aec-9d57-46db-a066-469d45132b57. >2012-08-06 16:46:48,994 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-45) [44e5640a] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity fbf4b601-4a1f-4f61-aea6-a939b6287dce is AddDisk (determined by task a00f6aec-9d57-46db-a066-469d45132b57) >2012-08-06 16:46:49,219 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-1) Polling and updating Async Tasks: 3 tasks, 1 tasks to poll now >2012-08-06 16:46:49,261 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-1) SPMAsyncTask::PollTask: Polling task a00f6aec-9d57-46db-a066-469d45132b57 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2012-08-06 16:46:49,262 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-1) Finished polling Tasks, will poll again in 10 seconds. >2012-08-06 16:46:52,928 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-17) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 30b596db >2012-08-06 16:46:54,197 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-17) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290, org.ovirt.engine.core.common.businessentities.LUNs@38814fbd, org.ovirt.engine.core.common.businessentities.LUNs@7cde8d2e, org.ovirt.engine.core.common.businessentities.LUNs@62aa792, org.ovirt.engine.core.common.businessentities.LUNs@4bccd83d, org.ovirt.engine.core.common.businessentities.LUNs@7fd282a2], log id: 30b596db >2012-08-06 16:46:59,287 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-47) [2b5eace3] SPMAsyncTask::PollTask: Polling task a00f6aec-9d57-46db-a066-469d45132b57 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 16:46:59,325 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-47) [2b5eace3] BaseAsyncTask::OnTaskEndSuccess: Task a00f6aec-9d57-46db-a066-469d45132b57 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 16:46:59,327 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-47) [2b5eace3] EntityAsyncTask::EndActionIfNecessary: All tasks of entity fbf4b601-4a1f-4f61-aea6-a939b6287dce has ended -> executing EndAction >2012-08-06 16:46:59,328 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-47) [2b5eace3] EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: fbf4b601-4a1f-4f61-aea6-a939b6287dce): calling EndAction for action type AddDisk. >2012-08-06 16:46:59,329 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-45) [2b5eace3] EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddDisk >2012-08-06 16:46:59,405 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-3-thread-45) [2b5eace3] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2012-08-06 16:46:59,405 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-45) [44e5640a] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2012-08-06 16:46:59,407 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-45) [44e5640a] START, GetImageInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, imageGroupId = fbf4b601-4a1f-4f61-aea6-a939b6287dce, imageId = be99ddfd-e771-4322-a713-a67964393fb9), log id: 2532a3c0 >2012-08-06 16:46:59,920 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-45) [44e5640a] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@197ea69e, log id: 2532a3c0 >2012-08-06 16:46:59,944 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-45) START, UpdateVMVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 56c3f2b2 >2012-08-06 16:46:59,982 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-45) FINISH, UpdateVMVDSCommand, log id: 56c3f2b2 >2012-08-06 16:47:00,021 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-45) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk completed, handling the result. >2012-08-06 16:47:00,021 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-45) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk succeeded, clearing tasks. >2012-08-06 16:47:00,034 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-45) SPMAsyncTask::ClearAsyncTask: Attempting to clear task a00f6aec-9d57-46db-a066-469d45132b57 >2012-08-06 16:47:00,035 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-45) START, SPMClearTaskVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = a00f6aec-9d57-46db-a066-469d45132b57), log id: 5f1b3506 >2012-08-06 16:47:00,037 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-45) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=a00f6aec-9d57-46db-a066-469d45132b57), log id: 65cfd485 >2012-08-06 16:47:00,060 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-45) FINISH, HSMClearTaskVDSCommand, log id: 65cfd485 >2012-08-06 16:47:00,060 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-45) FINISH, SPMClearTaskVDSCommand, log id: 5f1b3506 >2012-08-06 16:47:00,093 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-45) BaseAsyncTask::RemoveTaskFromDB: Removed task a00f6aec-9d57-46db-a066-469d45132b57 from DataBase >2012-08-06 16:47:00,094 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-45) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity fbf4b601-4a1f-4f61-aea6-a939b6287dce >2012-08-06 16:47:08,719 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-3) START, GetDeviceListVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storageType=ISCSI), log id: 7de7eb0e >2012-08-06 16:47:10,245 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8009-3) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@d11d1aed, org.ovirt.engine.core.common.businessentities.LUNs@eb57b290, org.ovirt.engine.core.common.businessentities.LUNs@38814fbd, org.ovirt.engine.core.common.businessentities.LUNs@7cde8d2e, org.ovirt.engine.core.common.businessentities.LUNs@62aa792, org.ovirt.engine.core.common.businessentities.LUNs@4bccd83d, org.ovirt.engine.core.common.businessentities.LUNs@7fd282a2], log id: 7de7eb0e >2012-08-06 16:47:16,266 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8009-27) Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 16:47:16,289 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-27) START, IsValidVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 24bcc24b >2012-08-06 16:47:16,291 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-27) FINISH, IsValidVDSCommand, return: true, log id: 24bcc24b >2012-08-06 16:47:16,352 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-3-thread-44) [71554f99] Running command: AddDiskCommand internal: false. Entities affected : ID: c6f4d0f1-f440-4096-90f5-cd57524d648d Type: VM, ID: 6eb052fb-6503-4d84-b053-62ed828dbbf2 Type: Storage >2012-08-06 16:47:16,699 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-44) [b57a080] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 6eb052fb-6503-4d84-b053-62ed828dbbf2 Type: Storage >2012-08-06 16:47:16,741 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-44) [b57a080] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 16:47:16,743 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-44) [b57a080] START, CreateImageVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2, imageGroupId = 6ba3a411-4c0a-4cb3-8d2b-44ea80dc531b, imageSizeInBytes = 2147483648, volumeFormat = RAW, newImageId = e4d11029-cf29-4bac-9617-0390dee472d2, newImageDescription = ), log id: 529bbfa4 >2012-08-06 16:47:16,744 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-44) [b57a080] -- CreateImageVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-08-06 16:47:16,745 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-44) [b57a080] -- createVolume parameters: > sdUUID=6eb052fb-6503-4d84-b053-62ed828dbbf2 > spUUID=7a858a05-d5d9-40de-9a4e-c24b1980eb23 > imgGUID=6ba3a411-4c0a-4cb3-8d2b-44ea80dc531b > size=2,147,483,648 bytes > volFormat=RAW > volType=Preallocated > volUUID=e4d11029-cf29-4bac-9617-0390dee472d2 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2012-08-06 16:47:17,028 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-44) [b57a080] FINISH, CreateImageVDSCommand, return: e4d11029-cf29-4bac-9617-0390dee472d2, log id: 529bbfa4 >2012-08-06 16:47:17,063 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) [b57a080] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 6ba3a411-4c0a-4cb3-8d2b-44ea80dc531b >2012-08-06 16:47:17,064 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-44) [b57a080] EntityMultiAsyncTasks::AttachTask: Attaching task 94fecbe2-d2ee-4c3f-b651-837ee9e9ecfa to entity 6ba3a411-4c0a-4cb3-8d2b-44ea80dc531b. >2012-08-06 16:47:17,065 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-44) [b57a080] Adding task 94fecbe2-d2ee-4c3f-b651-837ee9e9ecfa to DataBase >2012-08-06 16:47:17,113 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-44) [b57a080] Adding task 94fecbe2-d2ee-4c3f-b651-837ee9e9ecfa (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 16:47:17,299 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) [b57a080] BaseAsyncTask::StartPollingTask: Starting to poll task 94fecbe2-d2ee-4c3f-b651-837ee9e9ecfa. >2012-08-06 16:47:17,299 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-44) [b57a080] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 6ba3a411-4c0a-4cb3-8d2b-44ea80dc531b is AddDisk (determined by task 94fecbe2-d2ee-4c3f-b651-837ee9e9ecfa) >2012-08-06 16:47:19,333 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-48) Polling and updating Async Tasks: 4 tasks, 1 tasks to poll now >2012-08-06 16:47:19,366 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-48) SPMAsyncTask::PollTask: Polling task 94fecbe2-d2ee-4c3f-b651-837ee9e9ecfa (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 16:47:19,403 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-48) BaseAsyncTask::OnTaskEndSuccess: Task 94fecbe2-d2ee-4c3f-b651-837ee9e9ecfa (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 16:47:19,407 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-48) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 6ba3a411-4c0a-4cb3-8d2b-44ea80dc531b has ended -> executing EndAction >2012-08-06 16:47:19,408 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-48) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 6ba3a411-4c0a-4cb3-8d2b-44ea80dc531b): calling EndAction for action type AddDisk. >2012-08-06 16:47:19,409 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-45) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction AddDisk >2012-08-06 16:47:19,600 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-3-thread-45) Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2012-08-06 16:47:19,600 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-45) [b57a080] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2012-08-06 16:47:19,603 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-45) [b57a080] START, GetImageInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2, imageGroupId = 6ba3a411-4c0a-4cb3-8d2b-44ea80dc531b, imageId = e4d11029-cf29-4bac-9617-0390dee472d2), log id: 78e7f093 >2012-08-06 16:47:20,095 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-45) [b57a080] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@1e8e4895, log id: 78e7f093 >2012-08-06 16:47:20,141 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-45) START, UpdateVMVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 4ce0bf1d >2012-08-06 16:47:20,178 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-45) FINISH, UpdateVMVDSCommand, log id: 4ce0bf1d >2012-08-06 16:47:20,256 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-45) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk completed, handling the result. >2012-08-06 16:47:20,257 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-45) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk succeeded, clearing tasks. >2012-08-06 16:47:20,276 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-45) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 94fecbe2-d2ee-4c3f-b651-837ee9e9ecfa >2012-08-06 16:47:20,276 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-45) START, SPMClearTaskVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 94fecbe2-d2ee-4c3f-b651-837ee9e9ecfa), log id: 79a8ceca >2012-08-06 16:47:20,278 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-45) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=94fecbe2-d2ee-4c3f-b651-837ee9e9ecfa), log id: 1001f71c >2012-08-06 16:47:20,300 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-45) FINISH, HSMClearTaskVDSCommand, log id: 1001f71c >2012-08-06 16:47:20,301 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-45) FINISH, SPMClearTaskVDSCommand, log id: 79a8ceca >2012-08-06 16:47:20,327 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-45) BaseAsyncTask::RemoveTaskFromDB: Removed task 94fecbe2-d2ee-4c3f-b651-837ee9e9ecfa from DataBase >2012-08-06 16:47:20,327 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-45) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 6ba3a411-4c0a-4cb3-8d2b-44ea80dc531b >2012-08-06 16:47:43,058 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-36) Checking if user admin@internal is an admin, result true >2012-08-06 16:47:43,059 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-36) Running command: LoginAdminUserCommand internal: false. >2012-08-06 16:47:47,864 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-91) Setting new tasks map. The map contains now 2 tasks >2012-08-06 16:47:50,162 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8009-13) Lock Acquired to object EngineLock [exclusiveLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >, sharedLocks= ] >2012-08-06 16:47:50,168 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-13) START, IsValidVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4ee530fb >2012-08-06 16:47:50,170 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-13) FINISH, IsValidVDSCommand, return: true, log id: 4ee530fb >2012-08-06 16:47:50,230 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-13) START, IsVmDuringInitiatingVDSCommand(vmId = c6f4d0f1-f440-4096-90f5-cd57524d648d), log id: 51855aa6 >2012-08-06 16:47:50,231 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-13) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 51855aa6 >2012-08-06 16:47:50,304 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-44) [11c843b8] Running command: RunVmCommand internal: false. Entities affected : ID: c6f4d0f1-f440-4096-90f5-cd57524d648d Type: VM >2012-08-06 16:47:50,365 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-44) [11c843b8] START, CreateVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c6f4d0f1-f440-4096-90f5-cd57524d648d, vm=org.ovirt.engine.core.common.businessentities.VM@1214eec1), log id: 77365d04 >2012-08-06 16:47:50,376 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-44) [11c843b8] START, CreateVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c6f4d0f1-f440-4096-90f5-cd57524d648d, vm=org.ovirt.engine.core.common.businessentities.VM@1214eec1), log id: 5f36c8d4 >2012-08-06 16:47:50,480 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-44) [11c843b8] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=0,transparentHugePages=true,vmId=c6f4d0f1-f440-4096-90f5-cd57524d648d,devices=[Ljava.util.Map;@c9f2a4f,acpiEnable=true,vmName=dafna,cpuType=Conroe,custom={device_e2666f9a-1965-4a0c-97e0-d60832a2b70adevice_24ef1079-48c6-4f98-a454-a4103ddc229edevice_2caf939e-10cb-4e54-8b40-e7fd54af9572=VmId=c6f4d0f1-f440-4096-90f5-cd57524d648d,DeviceId=2caf939e-10cb-4e54-8b40-e7fd54af9572,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_e2666f9a-1965-4a0c-97e0-d60832a2b70adevice_24ef1079-48c6-4f98-a454-a4103ddc229edevice_2caf939e-10cb-4e54-8b40-e7fd54af9572device_44d1fcad-8c0e-44b1-9d5d-fc61e56924d1=VmId=c6f4d0f1-f440-4096-90f5-cd57524d648d,DeviceId=44d1fcad-8c0e-44b1-9d5d-fc61e56924d1,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_e2666f9a-1965-4a0c-97e0-d60832a2b70adevice_24ef1079-48c6-4f98-a454-a4103ddc229edevice_2caf939e-10cb-4e54-8b40-e7fd54af9572device_44d1fcad-8c0e-44b1-9d5d-fc61e56924d1device_c5ac8bce-0245-44c5-bc4b-a9b1909bbf14device_b5be7192-e747-4fd2-b6f2-84d62f347864=VmId=c6f4d0f1-f440-4096-90f5-cd57524d648d,DeviceId=b5be7192-e747-4fd2-b6f2-84d62f347864,Device=disk,Type=disk,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-disk1, device_e2666f9a-1965-4a0c-97e0-d60832a2b70a=VmId=c6f4d0f1-f440-4096-90f5-cd57524d648d,DeviceId=e2666f9a-1965-4a0c-97e0-d60832a2b70a,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_e2666f9a-1965-4a0c-97e0-d60832a2b70adevice_24ef1079-48c6-4f98-a454-a4103ddc229edevice_2caf939e-10cb-4e54-8b40-e7fd54af9572device_44d1fcad-8c0e-44b1-9d5d-fc61e56924d1device_c5ac8bce-0245-44c5-bc4b-a9b1909bbf14=VmId=c6f4d0f1-f440-4096-90f5-cd57524d648d,DeviceId=c5ac8bce-0245-44c5-bc4b-a9b1909bbf14,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_e2666f9a-1965-4a0c-97e0-d60832a2b70adevice_24ef1079-48c6-4f98-a454-a4103ddc229e=VmId=c6f4d0f1-f440-4096-90f5-cd57524d648d,DeviceId=24ef1079-48c6-4f98-a454-a4103ddc229e,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0} >2012-08-06 16:47:50,488 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-44) [11c843b8] FINISH, CreateVDSCommand, log id: 5f36c8d4 >2012-08-06 16:47:50,495 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-44) [11c843b8] IncreasePendingVms::CreateVmIncreasing vds purple-vds3 pending vcpu count, now 1. Vm: dafna >2012-08-06 16:47:50,553 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-44) [11c843b8] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 77365d04 >2012-08-06 16:47:50,554 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-44) [11c843b8] Lock freed to object EngineLock [exclusiveLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >, sharedLocks= ] >2012-08-06 16:47:53,212 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-96) VM dafna c6f4d0f1-f440-4096-90f5-cd57524d648d moved from WaitForLaunch --> PoweringUp >2012-08-06 16:47:53,213 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-96) START, FullListVdsCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=null, vmIds=[c6f4d0f1-f440-4096-90f5-cd57524d648d]), log id: 55d1ac7d >2012-08-06 16:47:53,233 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-96) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@38936e8f, log id: 55d1ac7d >2012-08-06 16:47:55,389 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp--127.0.0.1-8009-36) [2afac779] Running command: SetVmTicketCommand internal: false. Entities affected : ID: c6f4d0f1-f440-4096-90f5-cd57524d648d Type: VM >2012-08-06 16:47:55,395 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp--127.0.0.1-8009-36) [2afac779] START, SetVmTicketVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c6f4d0f1-f440-4096-90f5-cd57524d648d, ticket=cJnG4ovbgb7x, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 62e38c85 >2012-08-06 16:47:55,658 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp--127.0.0.1-8009-36) [2afac779] FINISH, SetVmTicketVDSCommand, log id: 62e38c85 >2012-08-06 16:48:17,864 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-60) Setting new tasks map. The map contains now 1 tasks >2012-08-06 16:48:28,528 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) [3094695f] Running command: ShutdownVmCommand internal: false. Entities affected : ID: c6f4d0f1-f440-4096-90f5-cd57524d648d Type: VM >2012-08-06 16:48:28,530 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) [3094695f] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop dafna). >2012-08-06 16:48:28,530 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) [3094695f] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop dafna, status is not up. Stopping instead. >2012-08-06 16:48:28,534 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-47) [125cf9bd] Running command: StopVmCommand internal: true. Entities affected : ID: c6f4d0f1-f440-4096-90f5-cd57524d648d Type: VM >2012-08-06 16:48:28,542 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-47) [125cf9bd] START, DestroyVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c6f4d0f1-f440-4096-90f5-cd57524d648d, force=false, secondsToWait=0, gracefully=false), log id: 7680acae >2012-08-06 16:48:28,559 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-47) [125cf9bd] START, DestroyVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c6f4d0f1-f440-4096-90f5-cd57524d648d, force=false, secondsToWait=0, gracefully=false), log id: 12e49de7 >2012-08-06 16:48:29,326 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-47) [125cf9bd] FINISH, DestroyVDSCommand, log id: 12e49de7 >2012-08-06 16:48:29,383 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-47) [125cf9bd] FINISH, DestroyVmVDSCommand, return: Down, log id: 7680acae >2012-08-06 16:48:30,039 WARN [org.ovirt.engine.core.bll.ShutdownVmCommand] (ajp--127.0.0.1-8009-16) CanDoAction of action ShutdownVm failed. Reasons:ACTION_TYPE_FAILED_VM_IS_NOT_RUNNING,VAR__ACTION__SHUTDOWN,VAR__TYPE__VM >2012-08-06 16:48:41,106 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp--127.0.0.1-8009-26) [628d8f79] Lock Acquired to object EngineLock [exclusiveLocks= key: dafna value: VM_NAME >, sharedLocks= ] >2012-08-06 16:48:41,107 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp--127.0.0.1-8009-26) Unable to get value of property: isQuotaDefault for class org.ovirt.engine.core.common.businessentities.VmStatic >2012-08-06 16:48:41,109 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp--127.0.0.1-8009-26) Unable to get value of property: isQuotaDefault for class org.ovirt.engine.core.common.businessentities.VmStatic >2012-08-06 16:48:41,110 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp--127.0.0.1-8009-26) Unable to get value of property: managedDeviceMap for class org.ovirt.engine.core.common.businessentities.VmStatic >2012-08-06 16:48:41,111 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp--127.0.0.1-8009-26) Unable to get value of property: managedDeviceMap for class org.ovirt.engine.core.common.businessentities.VmStatic >2012-08-06 16:48:41,204 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp--127.0.0.1-8009-26) [628d8f79] Running command: UpdateVmCommand internal: false. Entities affected : ID: c6f4d0f1-f440-4096-90f5-cd57524d648d Type: VM >2012-08-06 16:48:41,223 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-26) [628d8f79] START, IsValidVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6134522e >2012-08-06 16:48:41,225 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-26) [628d8f79] FINISH, IsValidVDSCommand, return: true, log id: 6134522e >2012-08-06 16:48:41,245 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (ajp--127.0.0.1-8009-26) [628d8f79] START, UpdateVMVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 1e58df13 >2012-08-06 16:48:41,280 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (ajp--127.0.0.1-8009-26) [628d8f79] FINISH, UpdateVMVDSCommand, log id: 1e58df13 >2012-08-06 16:48:41,300 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp--127.0.0.1-8009-26) [628d8f79] Lock freed to object EngineLock [exclusiveLocks= key: dafna value: VM_NAME >, sharedLocks= ] >2012-08-06 16:48:43,170 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8009-27) Lock Acquired to object EngineLock [exclusiveLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >, sharedLocks= ] >2012-08-06 16:48:43,178 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-27) START, IsValidVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 35e034e6 >2012-08-06 16:48:43,179 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp--127.0.0.1-8009-27) FINISH, IsValidVDSCommand, return: true, log id: 35e034e6 >2012-08-06 16:48:43,256 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-27) START, IsVmDuringInitiatingVDSCommand(vmId = c6f4d0f1-f440-4096-90f5-cd57524d648d), log id: 5aa7f24b >2012-08-06 16:48:43,257 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8009-27) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 5aa7f24b >2012-08-06 16:48:43,322 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-47) [71e020e3] Running command: RunVmCommand internal: false. Entities affected : ID: c6f4d0f1-f440-4096-90f5-cd57524d648d Type: VM >2012-08-06 16:48:43,363 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-47) [71e020e3] START, CreateVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c6f4d0f1-f440-4096-90f5-cd57524d648d, vm=org.ovirt.engine.core.common.businessentities.VM@1bc6fc8f), log id: 40acf7e5 >2012-08-06 16:48:43,371 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-47) [71e020e3] START, CreateVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c6f4d0f1-f440-4096-90f5-cd57524d648d, vm=org.ovirt.engine.core.common.businessentities.VM@1bc6fc8f), log id: 420bf0e7 >2012-08-06 16:48:43,475 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-47) [71e020e3] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=2048,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,pitReinjection=false,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=0,transparentHugePages=true,vmId=c6f4d0f1-f440-4096-90f5-cd57524d648d,devices=[Ljava.util.Map;@26c79b7a,acpiEnable=true,vmName=dafna,cpuType=Conroe,custom={device_43255160-6d48-4b29-98d0-db1464adc86f=VmId=c6f4d0f1-f440-4096-90f5-cd57524d648d,DeviceId=43255160-6d48-4b29-98d0-db1464adc86f,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_43255160-6d48-4b29-98d0-db1464adc86fdevice_32813851-6c29-4451-b668-3df3abe2116ddevice_a2998701-9680-4883-9543-7a3234915f06device_b87814bd-6342-4218-a554-82e9e6de764ddevice_e2666f9a-1965-4a0c-97e0-d60832a2b70a=VmId=c6f4d0f1-f440-4096-90f5-cd57524d648d,DeviceId=e2666f9a-1965-4a0c-97e0-d60832a2b70a,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_43255160-6d48-4b29-98d0-db1464adc86fdevice_32813851-6c29-4451-b668-3df3abe2116ddevice_a2998701-9680-4883-9543-7a3234915f06=VmId=c6f4d0f1-f440-4096-90f5-cd57524d648d,DeviceId=a2998701-9680-4883-9543-7a3234915f06,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_43255160-6d48-4b29-98d0-db1464adc86fdevice_32813851-6c29-4451-b668-3df3abe2116d=VmId=c6f4d0f1-f440-4096-90f5-cd57524d648d,DeviceId=32813851-6c29-4451-b668-3df3abe2116d,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_43255160-6d48-4b29-98d0-db1464adc86fdevice_32813851-6c29-4451-b668-3df3abe2116ddevice_a2998701-9680-4883-9543-7a3234915f06device_b87814bd-6342-4218-a554-82e9e6de764d=VmId=c6f4d0f1-f440-4096-90f5-cd57524d648d,DeviceId=b87814bd-6342-4218-a554-82e9e6de764d,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1} >2012-08-06 16:48:43,485 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-47) [71e020e3] FINISH, CreateVDSCommand, log id: 420bf0e7 >2012-08-06 16:48:43,495 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-47) [71e020e3] IncreasePendingVms::CreateVmIncreasing vds purple-vds3 pending vcpu count, now 1. Vm: dafna >2012-08-06 16:48:43,548 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-47) [71e020e3] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 40acf7e5 >2012-08-06 16:48:43,549 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-47) [71e020e3] Lock freed to object EngineLock [exclusiveLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >, sharedLocks= ] >2012-08-06 16:48:45,976 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-97) VM dafna c6f4d0f1-f440-4096-90f5-cd57524d648d moved from WaitForLaunch --> PoweringUp >2012-08-06 16:48:47,865 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-93) [406cbd81] Setting new tasks map. The map contains now 0 tasks >2012-08-06 16:48:47,866 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-93) [406cbd81] Cleared all tasks of pool 7a858a05-d5d9-40de-9a4e-c24b1980eb23. >2012-08-06 16:48:47,878 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-93) [406cbd81] Could not find vds that is spm and non-operational. >2012-08-06 16:48:48,501 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp--127.0.0.1-8009-6) [dca1601] Running command: SetVmTicketCommand internal: false. Entities affected : ID: c6f4d0f1-f440-4096-90f5-cd57524d648d Type: VM >2012-08-06 16:48:48,505 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp--127.0.0.1-8009-6) [dca1601] START, SetVmTicketVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c6f4d0f1-f440-4096-90f5-cd57524d648d, ticket=3QaHk/FqLDGZ, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 12d17e58 >2012-08-06 16:48:48,732 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp--127.0.0.1-8009-6) [dca1601] FINISH, SetVmTicketVDSCommand, log id: 12d17e58 >2012-08-06 16:49:45,477 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-2) VM dafna c6f4d0f1-f440-4096-90f5-cd57524d648d moved from PoweringUp --> Up >2012-08-06 16:49:45,501 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-2) START, UpdateVdsDynamicDataVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@35b6968a), log id: 111a8cc >2012-08-06 16:49:45,536 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-2) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 111a8cc >2012-08-06 16:49:49,765 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) domain 99bb665e-3421-4afb-bf70-d7b879c591b3 in problem. vds: purple-vds3 >2012-08-06 16:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable hosts >2012-08-06 16:50:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Autorecovering 0 hosts >2012-08-06 16:50:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable hosts done >2012-08-06 16:50:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable storage domains >2012-08-06 16:50:00,031 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Autorecovering 0 storage domains >2012-08-06 16:50:00,033 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable storage domains done >2012-08-06 16:51:01,156 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp--127.0.0.1-8009-16) [4b459d46] Running command: SetVmTicketCommand internal: false. Entities affected : ID: c6f4d0f1-f440-4096-90f5-cd57524d648d Type: VM >2012-08-06 16:51:01,160 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp--127.0.0.1-8009-16) [4b459d46] START, SetVmTicketVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c6f4d0f1-f440-4096-90f5-cd57524d648d, ticket=cmEhY+CTaq+v, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 362c0c0c >2012-08-06 16:51:01,406 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp--127.0.0.1-8009-16) [4b459d46] FINISH, SetVmTicketVDSCommand, log id: 362c0c0c >2012-08-06 16:51:32,555 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) domain 6eb052fb-6503-4d84-b053-62ed828dbbf2 in problem. vds: purple-vds3 >2012-08-06 16:51:38,699 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-91) VM dafna c6f4d0f1-f440-4096-90f5-cd57524d648d moved from Up --> Paused >2012-08-06 16:51:42,961 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) [406cbd81] Domain 6eb052fb-6503-4d84-b053-62ed828dbbf2 recovered from problem. vds: purple-vds3 >2012-08-06 16:51:42,965 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) [406cbd81] Domain 6eb052fb-6503-4d84-b053-62ed828dbbf2 has recovered from problem. No active host in the DC is reporting it as problematic, so clearing the domain recovery timer. >2012-08-06 16:51:52,217 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [540e7f00] Running command: ShutdownVmCommand internal: false. Entities affected : ID: c6f4d0f1-f440-4096-90f5-cd57524d648d Type: VM >2012-08-06 16:51:52,222 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [540e7f00] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop dafna). >2012-08-06 16:51:52,225 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) [540e7f00] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop dafna, status is not up. Stopping instead. >2012-08-06 16:51:52,233 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-44) [5ba4c8ed] Running command: StopVmCommand internal: true. Entities affected : ID: c6f4d0f1-f440-4096-90f5-cd57524d648d Type: VM >2012-08-06 16:51:52,238 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [5ba4c8ed] START, DestroyVmVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c6f4d0f1-f440-4096-90f5-cd57524d648d, force=false, secondsToWait=0, gracefully=false), log id: 5c8e0234 >2012-08-06 16:51:52,246 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [5ba4c8ed] START, DestroyVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vmId=c6f4d0f1-f440-4096-90f5-cd57524d648d, force=false, secondsToWait=0, gracefully=false), log id: 7a9218bf >2012-08-06 16:51:53,001 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [5ba4c8ed] FINISH, DestroyVDSCommand, log id: 7a9218bf >2012-08-06 16:51:53,030 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [5ba4c8ed] FINISH, DestroyVmVDSCommand, return: Down, log id: 5c8e0234 >2012-08-06 16:51:54,679 WARN [org.ovirt.engine.core.bll.ShutdownVmCommand] (ajp--127.0.0.1-8009-24) CanDoAction of action ShutdownVm failed. Reasons:ACTION_TYPE_FAILED_VM_IS_NOT_RUNNING,VAR__ACTION__SHUTDOWN,VAR__TYPE__VM >2012-08-06 16:52:07,169 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (ajp--127.0.0.1-8009-16) Lock Acquired to object EngineLock [exclusiveLocks= key: fbf4b601-4a1f-4f61-aea6-a939b6287dce value: DISK >, sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 16:52:07,207 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (pool-3-thread-44) The message key MoveOrCopyDisk is missing from bundles/ExecutionMessages >2012-08-06 16:52:07,326 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-44) [11e4cf66] Running command: MoveOrCopyDiskCommand internal: false. Entities affected : ID: fbf4b601-4a1f-4f61-aea6-a939b6287dce Type: Disk >2012-08-06 16:52:07,336 INFO [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-44) [11e4cf66] Running command: MoveOrCopyImageGroupCommand internal: true. Entities affected : ID: 6eb052fb-6503-4d84-b053-62ed828dbbf2 Type: Storage >2012-08-06 16:52:07,347 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDSCommand] (pool-3-thread-44) [11e4cf66] START, MoveImageGroupVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, imageGroupId = fbf4b601-4a1f-4f61-aea6-a939b6287dce, dstDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2, vmId = 00000000-0000-0000-0000-000000000000, op = Move, postZero = false, force = false), log id: 1e44bfff >2012-08-06 16:52:07,786 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-44) [11e4cf66] Failed in MoveImageGroupVDS method >2012-08-06 16:52:07,787 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-44) [11e4cf66] Error code MoveImageError and error message IRSGenericException: IRSErrorException: Failed to MoveImageGroupVDS, error = Error moving image: ('spUUID=7a858a05-d5d9-40de-9a4e-c24b1980eb23, srcDomUUID=99bb665e-3421-4afb-bf70-d7b879c591b3, dstDomUUID=6eb052fb-6503-4d84-b053-62ed828dbbf2, imgUUID=fbf4b601-4a1f-4f61-aea6-a939b6287dce, vmUUID=, op=2, force=false, postZero=false force=false',) >2012-08-06 16:52:07,793 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-3-thread-44) [11e4cf66] IrsBroker::Failed::MoveImageGroupVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to MoveImageGroupVDS, error = Error moving image: ('spUUID=7a858a05-d5d9-40de-9a4e-c24b1980eb23, srcDomUUID=99bb665e-3421-4afb-bf70-d7b879c591b3, dstDomUUID=6eb052fb-6503-4d84-b053-62ed828dbbf2, imgUUID=fbf4b601-4a1f-4f61-aea6-a939b6287dce, vmUUID=, op=2, force=false, postZero=false force=false',) >2012-08-06 16:52:07,801 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDSCommand] (pool-3-thread-44) [11e4cf66] FINISH, MoveImageGroupVDSCommand, log id: 1e44bfff >2012-08-06 16:52:07,803 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-44) [11e4cf66] Command org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to MoveImageGroupVDS, error = Error moving image: ('spUUID=7a858a05-d5d9-40de-9a4e-c24b1980eb23, srcDomUUID=99bb665e-3421-4afb-bf70-d7b879c591b3, dstDomUUID=6eb052fb-6503-4d84-b053-62ed828dbbf2, imgUUID=fbf4b601-4a1f-4f61-aea6-a939b6287dce, vmUUID=, op=2, force=false, postZero=false force=false',) >2012-08-06 16:52:07,816 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-44) [11e4cf66] Transaction rolled-back for command: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand. >2012-08-06 16:52:07,819 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-44) [11e4cf66] Lock freed to object EngineLock [exclusiveLocks= key: fbf4b601-4a1f-4f61-aea6-a939b6287dce value: DISK >, sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 16:53:00,973 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (ajp--127.0.0.1-8009-31) Lock Acquired to object EngineLock [exclusiveLocks= key: fbf4b601-4a1f-4f61-aea6-a939b6287dce value: DISK >, sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 16:53:01,054 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (pool-3-thread-44) The message key MoveOrCopyDisk is missing from bundles/ExecutionMessages >2012-08-06 16:53:01,119 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-44) [2ca506e0] Running command: MoveOrCopyDiskCommand internal: false. Entities affected : ID: fbf4b601-4a1f-4f61-aea6-a939b6287dce Type: Disk >2012-08-06 16:53:01,123 INFO [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-44) [2ca506e0] Running command: MoveOrCopyImageGroupCommand internal: true. Entities affected : ID: 6eb052fb-6503-4d84-b053-62ed828dbbf2 Type: Storage >2012-08-06 16:53:01,131 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDSCommand] (pool-3-thread-44) [2ca506e0] START, MoveImageGroupVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, imageGroupId = fbf4b601-4a1f-4f61-aea6-a939b6287dce, dstDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2, vmId = 00000000-0000-0000-0000-000000000000, op = Move, postZero = false, force = false), log id: 5c449831 >2012-08-06 16:53:01,430 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-44) [2ca506e0] Failed in MoveImageGroupVDS method >2012-08-06 16:53:01,432 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-44) [2ca506e0] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to MoveImageGroupVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 16:53:01,438 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-3-thread-44) [2ca506e0] IrsBroker::Failed::MoveImageGroupVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to MoveImageGroupVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 16:53:01,444 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDSCommand] (pool-3-thread-44) [2ca506e0] FINISH, MoveImageGroupVDSCommand, log id: 5c449831 >2012-08-06 16:53:01,447 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-44) [2ca506e0] Command org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to MoveImageGroupVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 16:53:01,456 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-44) [2ca506e0] Transaction rolled-back for command: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand. >2012-08-06 16:53:01,460 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-44) [2ca506e0] Lock freed to object EngineLock [exclusiveLocks= key: fbf4b601-4a1f-4f61-aea6-a939b6287dce value: DISK >, sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 16:53:38,853 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (ajp--127.0.0.1-8009-26) Lock Acquired to object EngineLock [exclusiveLocks= key: fbf4b601-4a1f-4f61-aea6-a939b6287dce value: DISK >, sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 16:53:38,892 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (pool-3-thread-44) The message key MoveOrCopyDisk is missing from bundles/ExecutionMessages >2012-08-06 16:53:39,004 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-44) [5336c541] Running command: MoveOrCopyDiskCommand internal: false. Entities affected : ID: fbf4b601-4a1f-4f61-aea6-a939b6287dce Type: Disk >2012-08-06 16:53:39,012 INFO [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-44) [5336c541] Running command: MoveOrCopyImageGroupCommand internal: true. Entities affected : ID: 6eb052fb-6503-4d84-b053-62ed828dbbf2 Type: Storage >2012-08-06 16:53:39,020 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDSCommand] (pool-3-thread-44) [5336c541] START, MoveImageGroupVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, imageGroupId = fbf4b601-4a1f-4f61-aea6-a939b6287dce, dstDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2, vmId = 00000000-0000-0000-0000-000000000000, op = Move, postZero = false, force = false), log id: 23115378 >2012-08-06 16:53:40,189 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDSCommand] (pool-3-thread-44) [5336c541] FINISH, MoveImageGroupVDSCommand, log id: 23115378 >2012-08-06 16:53:40,200 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) [5336c541] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity be99ddfd-e771-4322-a713-a67964393fb9 >2012-08-06 16:53:40,204 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-44) [5336c541] EntityMultiAsyncTasks::AttachTask: Attaching task 05170afd-523a-4c6f-8a7b-a4bde9d53555 to entity be99ddfd-e771-4322-a713-a67964393fb9. >2012-08-06 16:53:40,209 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-44) [5336c541] Adding task 05170afd-523a-4c6f-8a7b-a4bde9d53555 to DataBase >2012-08-06 16:53:40,256 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-44) [5336c541] Adding task 05170afd-523a-4c6f-8a7b-a4bde9d53555 (Parent Command MoveOrCopyDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 16:53:40,352 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-44) [5336c541] Lock freed to object EngineLock [exclusiveLocks= key: fbf4b601-4a1f-4f61-aea6-a939b6287dce value: DISK >, sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 16:53:40,415 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) [5336c541] BaseAsyncTask::StartPollingTask: Starting to poll task 05170afd-523a-4c6f-8a7b-a4bde9d53555. >2012-08-06 16:53:40,415 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-44) [5336c541] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity be99ddfd-e771-4322-a713-a67964393fb9 is MoveOrCopyDisk (determined by task 05170afd-523a-4c6f-8a7b-a4bde9d53555) >2012-08-06 16:53:49,426 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-21) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2012-08-06 16:53:49,458 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-21) SPMAsyncTask::PollTask: Polling task 05170afd-523a-4c6f-8a7b-a4bde9d53555 (Parent Command MoveOrCopyDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2012-08-06 16:53:49,459 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-21) Finished polling Tasks, will poll again in 10 seconds. >2012-08-06 16:54:49,766 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) starting ProcessDomainRecovery for domain 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 16:54:49,770 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) domain 99bb665e-3421-4afb-bf70-d7b879c591b3 was reported by all hosts in status UP as problematic. Moving the Domain to NonOperational. >2012-08-06 16:54:49,818 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (QuartzScheduler_Worker-31) [2a21fa90] The message key HandleFailedStorageDomain is missing from bundles/ExecutionMessages >2012-08-06 16:54:49,887 INFO [org.ovirt.engine.core.bll.storage.HandleFailedStorageDomainCommand] (QuartzScheduler_Worker-31) [2a21fa90] Running command: HandleFailedStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:54:49,935 WARN [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (QuartzScheduler_Worker-31) [2a21fa90] CanDoAction of action DeactivateStorageDomain failed. Reasons:VAR__TYPE__STORAGE__DOMAIN,VAR__ACTION__DEACTIVATE,ERROR_CANNOT_DEACTIVATE_DOMAIN_WITH_TASKS >2012-08-06 16:54:49,961 ERROR [org.ovirt.engine.core.bll.storage.HandleFailedStorageDomainCommand] (QuartzScheduler_Worker-31) [2a21fa90] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.HandleFailedStorageDomainCommand. >2012-08-06 16:54:49,967 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-31) [2a21fa90] No string for UNASSIGNED type. Use default Log >2012-08-06 16:54:57,069 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-64) domain 99bb665e-3421-4afb-bf70-d7b879c591b3 in problem. vds: purple-vds3 >2012-08-06 16:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable hosts >2012-08-06 16:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Autorecovering 0 hosts >2012-08-06 16:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable hosts done >2012-08-06 16:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable storage domains >2012-08-06 16:55:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Autorecovering 0 storage domains >2012-08-06 16:55:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable storage domains done >2012-08-06 16:55:39,853 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-47) [2b5eace3] SPMAsyncTask::PollTask: Polling task 05170afd-523a-4c6f-8a7b-a4bde9d53555 (Parent Command MoveOrCopyDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 16:55:39,869 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-47) [2b5eace3] BaseAsyncTask::OnTaskEndSuccess: Task 05170afd-523a-4c6f-8a7b-a4bde9d53555 (Parent Command MoveOrCopyDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 16:55:39,875 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-47) [2b5eace3] EntityAsyncTask::EndActionIfNecessary: All tasks of entity be99ddfd-e771-4322-a713-a67964393fb9 has ended -> executing EndAction >2012-08-06 16:55:39,879 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-47) [2b5eace3] EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: be99ddfd-e771-4322-a713-a67964393fb9): calling EndAction for action type MoveOrCopyDisk. >2012-08-06 16:55:39,883 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) [2b5eace3] EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction MoveOrCopyDisk >2012-08-06 16:55:39,942 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-44) [2b5eace3] Ending command successfully: org.ovirt.engine.core.bll.MoveOrCopyDiskCommand >2012-08-06 16:55:39,945 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-44) [2b5eace3] START, GetImageInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2, imageGroupId = fbf4b601-4a1f-4f61-aea6-a939b6287dce, imageId = be99ddfd-e771-4322-a713-a67964393fb9), log id: 5829e690 >2012-08-06 16:55:40,250 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-44) [2b5eace3] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@6061f4d0, log id: 5829e690 >2012-08-06 16:55:40,493 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type MoveOrCopyDisk completed, handling the result. >2012-08-06 16:55:40,493 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type MoveOrCopyDisk succeeded, clearing tasks. >2012-08-06 16:55:40,509 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 05170afd-523a-4c6f-8a7b-a4bde9d53555 >2012-08-06 16:55:40,510 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) START, SPMClearTaskVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 05170afd-523a-4c6f-8a7b-a4bde9d53555), log id: 3da1ecad >2012-08-06 16:55:40,512 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=05170afd-523a-4c6f-8a7b-a4bde9d53555), log id: 583e7c74 >2012-08-06 16:55:40,539 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) FINISH, HSMClearTaskVDSCommand, log id: 583e7c74 >2012-08-06 16:55:40,540 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) FINISH, SPMClearTaskVDSCommand, log id: 3da1ecad >2012-08-06 16:55:40,556 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) BaseAsyncTask::RemoveTaskFromDB: Removed task 05170afd-523a-4c6f-8a7b-a4bde9d53555 from DataBase >2012-08-06 16:55:40,559 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity be99ddfd-e771-4322-a713-a67964393fb9 >2012-08-06 16:56:47,891 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-36) Setting new tasks map. The map contains now 0 tasks >2012-08-06 16:56:47,892 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-36) Cleared all tasks of pool 7a858a05-d5d9-40de-9a4e-c24b1980eb23. >2012-08-06 16:56:47,908 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-36) Could not find vds that is spm and non-operational. >2012-08-06 16:59:57,074 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) starting ProcessDomainRecovery for domain 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 16:59:57,078 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) domain 99bb665e-3421-4afb-bf70-d7b879c591b3 was reported by all hosts in status UP as problematic. Moving the Domain to NonOperational. >2012-08-06 16:59:57,097 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (QuartzScheduler_Worker-49) [286c3454] The message key HandleFailedStorageDomain is missing from bundles/ExecutionMessages >2012-08-06 16:59:57,154 INFO [org.ovirt.engine.core.bll.storage.HandleFailedStorageDomainCommand] (QuartzScheduler_Worker-49) [286c3454] Running command: HandleFailedStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:59:57,183 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (QuartzScheduler_Worker-49) [286c3454] Running command: DeactivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 16:59:57,208 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (QuartzScheduler_Worker-49) [286c3454] START, DeactivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 2), log id: 45918ddc >2012-08-06 16:59:58,338 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (QuartzScheduler_Worker-49) [286c3454] FINISH, DeactivateStorageDomainVDSCommand, log id: 45918ddc >2012-08-06 16:59:58,363 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (pool-3-thread-48) [286c3454] After deactivate treatment vds: purple-vds3,pool scsi >2012-08-06 16:59:58,384 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-3-thread-48) [286c3454] START, RefreshStoragePoolVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, masterStorageDomainId=6eb052fb-6503-4d84-b053-62ed828dbbf2, msterVersion=2), log id: 56e754f6 >2012-08-06 17:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable hosts >2012-08-06 17:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Autorecovering 0 hosts >2012-08-06 17:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable hosts done >2012-08-06 17:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable storage domains >2012-08-06 17:00:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Autorecovering 0 storage domains >2012-08-06 17:00:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable storage domains done >2012-08-06 17:00:00,570 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-3-thread-48) [286c3454] FINISH, RefreshStoragePoolVDSCommand, log id: 56e754f6 >2012-08-06 17:00:00,614 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (QuartzScheduler_Worker-49) [286c3454] START, DisconnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 3edbdf0f >2012-08-06 17:00:02,238 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (QuartzScheduler_Worker-49) [286c3454] FINISH, DisconnectStorageServerVDSCommand, return: {b2cd73d6-cacf-402b-b327-8ec359c99001=0, d7f70e98-f2e9-44ba-b348-a0df8451fc68=0}, log id: 3edbdf0f >2012-08-06 17:00:02,293 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-49) [286c3454] No string for UNASSIGNED type. Use default Log >2012-08-06 17:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Checking autorecoverable hosts >2012-08-06 17:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Autorecovering 0 hosts >2012-08-06 17:05:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Checking autorecoverable hosts done >2012-08-06 17:05:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Checking autorecoverable storage domains >2012-08-06 17:05:00,021 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Autorecovering 1 storage domains >2012-08-06 17:05:00,025 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 17:05:00,032 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-87) [2fdda954] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 17:05:00,115 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-87) [2fdda954] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 17:05:00,152 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-87) [2fdda954] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 17:05:00,156 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-87) [2fdda954] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 5:05 PM >2012-08-06 17:05:00,180 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [2fdda954] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 1ca62e70 >2012-08-06 17:05:01,615 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [2fdda954] FINISH, ConnectStorageServerVDSCommand, return: {b2cd73d6-cacf-402b-b327-8ec359c99001=0, d7f70e98-f2e9-44ba-b348-a0df8451fc68=0}, log id: 1ca62e70 >2012-08-06 17:05:01,617 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-87) [2fdda954] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 5:05 PM >2012-08-06 17:05:01,618 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-87) [2fdda954] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 52943d5 >2012-08-06 17:05:04,024 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-87) [2fdda954] FINISH, ActivateStorageDomainVDSCommand, log id: 52943d5 >2012-08-06 17:05:04,025 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-87) [2fdda954] ActivateStorage Domain. After Activate storage domain in vds. Time:8/6/12 5:05 PM >2012-08-06 17:05:04,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-3-thread-47) [2fdda954] START, RefreshStoragePoolVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, masterStorageDomainId=6eb052fb-6503-4d84-b053-62ed828dbbf2, msterVersion=2), log id: 527ab141 >2012-08-06 17:05:06,218 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-3-thread-47) [2fdda954] FINISH, RefreshStoragePoolVDSCommand, log id: 527ab141 >2012-08-06 17:05:06,219 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (pool-3-thread-47) [2fdda954] Refreshed vds purple-vds3 in pool scsi >2012-08-06 17:05:06,221 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-87) [2fdda954] ActivateStorage Domain. After Refresh all pools . Time:8/6/12 5:05 PM >2012-08-06 17:05:06,244 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-87) [2fdda954] ActivateStorage Domain. After change storage pool status in vds. Time:8/6/12 5:05 PM >2012-08-06 17:05:06,278 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) [2fdda954] Checking autorecoverable storage domains done >2012-08-06 17:05:26,955 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (ajp--127.0.0.1-8009-31) Lock Acquired to object EngineLock [exclusiveLocks= key: fbf4b601-4a1f-4f61-aea6-a939b6287dce value: DISK >, sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 17:05:27,032 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (pool-3-thread-44) The message key MoveOrCopyDisk is missing from bundles/ExecutionMessages >2012-08-06 17:05:27,107 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-44) [189f8443] Running command: MoveOrCopyDiskCommand internal: false. Entities affected : ID: fbf4b601-4a1f-4f61-aea6-a939b6287dce Type: Disk >2012-08-06 17:05:27,118 INFO [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-44) [189f8443] Running command: MoveOrCopyImageGroupCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 17:05:27,125 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDSCommand] (pool-3-thread-44) [189f8443] START, MoveImageGroupVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2, imageGroupId = fbf4b601-4a1f-4f61-aea6-a939b6287dce, dstDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, vmId = 00000000-0000-0000-0000-000000000000, op = Move, postZero = false, force = false), log id: 9c387c >2012-08-06 17:05:28,102 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDSCommand] (pool-3-thread-44) [189f8443] FINISH, MoveImageGroupVDSCommand, log id: 9c387c >2012-08-06 17:05:28,119 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) [189f8443] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity be99ddfd-e771-4322-a713-a67964393fb9 >2012-08-06 17:05:28,120 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-44) [189f8443] EntityMultiAsyncTasks::AttachTask: Attaching task ecd61468-25b0-4218-ab12-022889db57e7 to entity be99ddfd-e771-4322-a713-a67964393fb9. >2012-08-06 17:05:28,123 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-44) [189f8443] Adding task ecd61468-25b0-4218-ab12-022889db57e7 to DataBase >2012-08-06 17:05:28,158 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-44) [189f8443] Adding task ecd61468-25b0-4218-ab12-022889db57e7 (Parent Command MoveOrCopyDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 17:05:28,227 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-44) [189f8443] Lock freed to object EngineLock [exclusiveLocks= key: fbf4b601-4a1f-4f61-aea6-a939b6287dce value: DISK >, sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 17:05:28,313 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) [189f8443] BaseAsyncTask::StartPollingTask: Starting to poll task ecd61468-25b0-4218-ab12-022889db57e7. >2012-08-06 17:05:28,314 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-44) [189f8443] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity be99ddfd-e771-4322-a713-a67964393fb9 is MoveOrCopyDisk (determined by task ecd61468-25b0-4218-ab12-022889db57e7) >2012-08-06 17:05:29,905 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-35) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2012-08-06 17:05:29,933 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-35) SPMAsyncTask::PollTask: Polling task ecd61468-25b0-4218-ab12-022889db57e7 (Parent Command MoveOrCopyDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2012-08-06 17:05:29,936 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-35) Finished polling Tasks, will poll again in 10 seconds. >2012-08-06 17:07:30,313 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-33) SPMAsyncTask::PollTask: Polling task ecd61468-25b0-4218-ab12-022889db57e7 (Parent Command MoveOrCopyDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 17:07:30,346 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-33) BaseAsyncTask::OnTaskEndSuccess: Task ecd61468-25b0-4218-ab12-022889db57e7 (Parent Command MoveOrCopyDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 17:07:30,348 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-33) EntityAsyncTask::EndActionIfNecessary: All tasks of entity be99ddfd-e771-4322-a713-a67964393fb9 has ended -> executing EndAction >2012-08-06 17:07:30,353 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-33) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: be99ddfd-e771-4322-a713-a67964393fb9): calling EndAction for action type MoveOrCopyDisk. >2012-08-06 17:07:30,357 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction MoveOrCopyDisk >2012-08-06 17:07:30,375 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-44) Ending command successfully: org.ovirt.engine.core.bll.MoveOrCopyDiskCommand >2012-08-06 17:07:30,379 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-44) START, GetImageInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, imageGroupId = fbf4b601-4a1f-4f61-aea6-a939b6287dce, imageId = be99ddfd-e771-4322-a713-a67964393fb9), log id: 7442639a >2012-08-06 17:07:30,682 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-44) FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@197ea69e, log id: 7442639a >2012-08-06 17:07:30,770 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type MoveOrCopyDisk completed, handling the result. >2012-08-06 17:07:30,771 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type MoveOrCopyDisk succeeded, clearing tasks. >2012-08-06 17:07:30,788 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) SPMAsyncTask::ClearAsyncTask: Attempting to clear task ecd61468-25b0-4218-ab12-022889db57e7 >2012-08-06 17:07:30,789 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) START, SPMClearTaskVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = ecd61468-25b0-4218-ab12-022889db57e7), log id: 5073c759 >2012-08-06 17:07:30,800 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=ecd61468-25b0-4218-ab12-022889db57e7), log id: 612a224b >2012-08-06 17:07:30,843 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) FINISH, HSMClearTaskVDSCommand, log id: 612a224b >2012-08-06 17:07:30,844 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) FINISH, SPMClearTaskVDSCommand, log id: 5073c759 >2012-08-06 17:07:30,855 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) BaseAsyncTask::RemoveTaskFromDB: Removed task ecd61468-25b0-4218-ab12-022889db57e7 from DataBase >2012-08-06 17:07:30,858 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity be99ddfd-e771-4322-a713-a67964393fb9 >2012-08-06 17:08:47,919 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-89) Setting new tasks map. The map contains now 0 tasks >2012-08-06 17:08:47,920 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-89) Cleared all tasks of pool 7a858a05-d5d9-40de-9a4e-c24b1980eb23. >2012-08-06 17:08:47,925 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-89) Could not find vds that is spm and non-operational. >2012-08-06 17:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Checking autorecoverable hosts >2012-08-06 17:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Autorecovering 0 hosts >2012-08-06 17:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Checking autorecoverable hosts done >2012-08-06 17:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Checking autorecoverable storage domains >2012-08-06 17:10:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Autorecovering 0 storage domains >2012-08-06 17:10:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Checking autorecoverable storage domains done >2012-08-06 17:11:26,123 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (ajp--127.0.0.1-8009-4) Lock Acquired to object EngineLock [exclusiveLocks= key: fbf4b601-4a1f-4f61-aea6-a939b6287dce value: DISK >, sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 17:11:26,158 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (pool-3-thread-47) The message key MoveOrCopyDisk is missing from bundles/ExecutionMessages >2012-08-06 17:11:26,219 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-47) [2613c269] Running command: MoveOrCopyDiskCommand internal: false. Entities affected : ID: fbf4b601-4a1f-4f61-aea6-a939b6287dce Type: Disk >2012-08-06 17:11:26,225 INFO [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-47) [2613c269] Running command: MoveOrCopyImageGroupCommand internal: true. Entities affected : ID: 6eb052fb-6503-4d84-b053-62ed828dbbf2 Type: Storage >2012-08-06 17:11:26,231 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDSCommand] (pool-3-thread-47) [2613c269] START, MoveImageGroupVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, imageGroupId = fbf4b601-4a1f-4f61-aea6-a939b6287dce, dstDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2, vmId = 00000000-0000-0000-0000-000000000000, op = Move, postZero = false, force = false), log id: 254330e9 >2012-08-06 17:11:29,208 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-62) domain 99bb665e-3421-4afb-bf70-d7b879c591b3 in problem. vds: purple-vds3 >2012-08-06 17:11:39,571 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-68) domain 6eb052fb-6503-4d84-b053-62ed828dbbf2 in problem. vds: purple-vds3 >2012-08-06 17:13:10,097 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-47) [2613c269] Failed in MoveImageGroupVDS method >2012-08-06 17:13:10,097 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-47) [2613c269] Error code MoveImageError and error message IRSGenericException: IRSErrorException: Failed to MoveImageGroupVDS, error = Error moving image: ('spUUID=7a858a05-d5d9-40de-9a4e-c24b1980eb23, srcDomUUID=99bb665e-3421-4afb-bf70-d7b879c591b3, dstDomUUID=6eb052fb-6503-4d84-b053-62ed828dbbf2, imgUUID=fbf4b601-4a1f-4f61-aea6-a939b6287dce, vmUUID=, op=2, force=false, postZero=false force=false',) >2012-08-06 17:13:10,100 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-3-thread-47) [2613c269] IrsBroker::Failed::MoveImageGroupVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to MoveImageGroupVDS, error = Error moving image: ('spUUID=7a858a05-d5d9-40de-9a4e-c24b1980eb23, srcDomUUID=99bb665e-3421-4afb-bf70-d7b879c591b3, dstDomUUID=6eb052fb-6503-4d84-b053-62ed828dbbf2, imgUUID=fbf4b601-4a1f-4f61-aea6-a939b6287dce, vmUUID=, op=2, force=false, postZero=false force=false',) >2012-08-06 17:13:10,112 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDSCommand] (pool-3-thread-47) [2613c269] FINISH, MoveImageGroupVDSCommand, log id: 254330e9 >2012-08-06 17:13:10,115 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-47) [2613c269] Command org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to MoveImageGroupVDS, error = Error moving image: ('spUUID=7a858a05-d5d9-40de-9a4e-c24b1980eb23, srcDomUUID=99bb665e-3421-4afb-bf70-d7b879c591b3, dstDomUUID=6eb052fb-6503-4d84-b053-62ed828dbbf2, imgUUID=fbf4b601-4a1f-4f61-aea6-a939b6287dce, vmUUID=, op=2, force=false, postZero=false force=false',) >2012-08-06 17:13:10,129 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-47) [2613c269] Transaction rolled-back for command: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand. >2012-08-06 17:13:10,133 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-47) [2613c269] Lock freed to object EngineLock [exclusiveLocks= key: fbf4b601-4a1f-4f61-aea6-a939b6287dce value: DISK >, sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 17:13:11,400 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-43) Domain 6eb052fb-6503-4d84-b053-62ed828dbbf2 recovered from problem. vds: purple-vds3 >2012-08-06 17:13:11,403 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-43) Domain 6eb052fb-6503-4d84-b053-62ed828dbbf2 has recovered from problem. No active host in the DC is reporting it as problematic, so clearing the domain recovery timer. >2012-08-06 17:14:22,705 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) Domain 99bb665e-3421-4afb-bf70-d7b879c591b3 recovered from problem. vds: purple-vds3 >2012-08-06 17:14:22,706 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) Domain 99bb665e-3421-4afb-bf70-d7b879c591b3 has recovered from problem. No active host in the DC is reporting it as problematic, so clearing the domain recovery timer. >2012-08-06 17:14:37,748 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (ajp--127.0.0.1-8009-8) Lock Acquired to object EngineLock [exclusiveLocks= key: fbf4b601-4a1f-4f61-aea6-a939b6287dce value: DISK >, sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 17:14:37,812 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (pool-3-thread-47) The message key MoveOrCopyDisk is missing from bundles/ExecutionMessages >2012-08-06 17:14:37,897 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-47) [3e644a92] Running command: MoveOrCopyDiskCommand internal: false. Entities affected : ID: fbf4b601-4a1f-4f61-aea6-a939b6287dce Type: Disk >2012-08-06 17:14:37,900 INFO [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-47) [3e644a92] Running command: MoveOrCopyImageGroupCommand internal: true. Entities affected : ID: 6eb052fb-6503-4d84-b053-62ed828dbbf2 Type: Storage >2012-08-06 17:14:37,902 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDSCommand] (pool-3-thread-47) [3e644a92] START, MoveImageGroupVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, imageGroupId = fbf4b601-4a1f-4f61-aea6-a939b6287dce, dstDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2, vmId = 00000000-0000-0000-0000-000000000000, op = Move, postZero = false, force = false), log id: 5e21c8cd >2012-08-06 17:14:38,835 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDSCommand] (pool-3-thread-47) [3e644a92] FINISH, MoveImageGroupVDSCommand, log id: 5e21c8cd >2012-08-06 17:14:38,848 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-47) [3e644a92] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity be99ddfd-e771-4322-a713-a67964393fb9 >2012-08-06 17:14:38,849 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-47) [3e644a92] EntityMultiAsyncTasks::AttachTask: Attaching task 8edbd6f4-5951-437d-946c-5f33c8e3c380 to entity be99ddfd-e771-4322-a713-a67964393fb9. >2012-08-06 17:14:38,850 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-47) [3e644a92] Adding task 8edbd6f4-5951-437d-946c-5f33c8e3c380 to DataBase >2012-08-06 17:14:38,878 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-47) [3e644a92] Adding task 8edbd6f4-5951-437d-946c-5f33c8e3c380 (Parent Command MoveOrCopyDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 17:14:38,922 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-47) [3e644a92] Lock freed to object EngineLock [exclusiveLocks= key: fbf4b601-4a1f-4f61-aea6-a939b6287dce value: DISK >, sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 17:14:38,958 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-47) [3e644a92] BaseAsyncTask::StartPollingTask: Starting to poll task 8edbd6f4-5951-437d-946c-5f33c8e3c380. >2012-08-06 17:14:38,959 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-47) [3e644a92] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity be99ddfd-e771-4322-a713-a67964393fb9 is MoveOrCopyDisk (determined by task 8edbd6f4-5951-437d-946c-5f33c8e3c380) >2012-08-06 17:14:40,377 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-79) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2012-08-06 17:14:40,404 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-79) SPMAsyncTask::PollTask: Polling task 8edbd6f4-5951-437d-946c-5f33c8e3c380 (Parent Command MoveOrCopyDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2012-08-06 17:14:40,408 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-79) Finished polling Tasks, will poll again in 10 seconds. >2012-08-06 17:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) [2b5eace3] Checking autorecoverable hosts >2012-08-06 17:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) [2b5eace3] Autorecovering 0 hosts >2012-08-06 17:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) [2b5eace3] Checking autorecoverable hosts done >2012-08-06 17:15:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) [2b5eace3] Checking autorecoverable storage domains >2012-08-06 17:15:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) [2b5eace3] Autorecovering 0 storage domains >2012-08-06 17:15:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) [2b5eace3] Checking autorecoverable storage domains done >2012-08-06 17:16:50,825 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-2) SPMAsyncTask::PollTask: Polling task 8edbd6f4-5951-437d-946c-5f33c8e3c380 (Parent Command MoveOrCopyDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 17:16:50,844 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-2) BaseAsyncTask::OnTaskEndSuccess: Task 8edbd6f4-5951-437d-946c-5f33c8e3c380 (Parent Command MoveOrCopyDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 17:16:50,845 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-2) EntityAsyncTask::EndActionIfNecessary: All tasks of entity be99ddfd-e771-4322-a713-a67964393fb9 has ended -> executing EndAction >2012-08-06 17:16:50,851 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-2) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: be99ddfd-e771-4322-a713-a67964393fb9): calling EndAction for action type MoveOrCopyDisk. >2012-08-06 17:16:50,852 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction MoveOrCopyDisk >2012-08-06 17:16:50,885 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-44) Ending command successfully: org.ovirt.engine.core.bll.MoveOrCopyDiskCommand >2012-08-06 17:16:50,887 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-44) START, GetImageInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2, imageGroupId = fbf4b601-4a1f-4f61-aea6-a939b6287dce, imageId = be99ddfd-e771-4322-a713-a67964393fb9), log id: 22dd923d >2012-08-06 17:16:51,167 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-44) FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@6061f4d0, log id: 22dd923d >2012-08-06 17:16:51,286 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type MoveOrCopyDisk completed, handling the result. >2012-08-06 17:16:51,286 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type MoveOrCopyDisk succeeded, clearing tasks. >2012-08-06 17:16:51,299 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 8edbd6f4-5951-437d-946c-5f33c8e3c380 >2012-08-06 17:16:51,299 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) START, SPMClearTaskVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 8edbd6f4-5951-437d-946c-5f33c8e3c380), log id: 57981503 >2012-08-06 17:16:51,301 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=8edbd6f4-5951-437d-946c-5f33c8e3c380), log id: 313b6564 >2012-08-06 17:16:51,323 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) FINISH, HSMClearTaskVDSCommand, log id: 313b6564 >2012-08-06 17:16:51,324 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) FINISH, SPMClearTaskVDSCommand, log id: 57981503 >2012-08-06 17:16:51,334 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) BaseAsyncTask::RemoveTaskFromDB: Removed task 8edbd6f4-5951-437d-946c-5f33c8e3c380 from DataBase >2012-08-06 17:16:51,334 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity be99ddfd-e771-4322-a713-a67964393fb9 >2012-08-06 17:18:17,939 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-55) [1bfcbc57] Setting new tasks map. The map contains now 0 tasks >2012-08-06 17:18:17,940 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-55) [1bfcbc57] Cleared all tasks of pool 7a858a05-d5d9-40de-9a4e-c24b1980eb23. >2012-08-06 17:18:17,943 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-55) [1bfcbc57] Could not find vds that is spm and non-operational. >2012-08-06 17:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable hosts >2012-08-06 17:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Autorecovering 0 hosts >2012-08-06 17:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable hosts done >2012-08-06 17:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable storage domains >2012-08-06 17:20:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Autorecovering 0 storage domains >2012-08-06 17:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable storage domains done >2012-08-06 17:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Checking autorecoverable hosts >2012-08-06 17:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Autorecovering 0 hosts >2012-08-06 17:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Checking autorecoverable hosts done >2012-08-06 17:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Checking autorecoverable storage domains >2012-08-06 17:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Autorecovering 0 storage domains >2012-08-06 17:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Checking autorecoverable storage domains done >2012-08-06 17:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable hosts >2012-08-06 17:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Autorecovering 0 hosts >2012-08-06 17:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable hosts done >2012-08-06 17:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable storage domains >2012-08-06 17:30:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Autorecovering 0 storage domains >2012-08-06 17:30:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable storage domains done >2012-08-06 17:32:40,907 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (ajp--127.0.0.1-8009-31) Lock Acquired to object EngineLock [exclusiveLocks= key: fbf4b601-4a1f-4f61-aea6-a939b6287dce value: DISK >, sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 17:32:40,944 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (pool-3-thread-45) The message key MoveOrCopyDisk is missing from bundles/ExecutionMessages >2012-08-06 17:32:41,002 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-45) [5f139010] Running command: MoveOrCopyDiskCommand internal: false. Entities affected : ID: fbf4b601-4a1f-4f61-aea6-a939b6287dce Type: Disk >2012-08-06 17:32:41,005 INFO [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-45) [5f139010] Running command: MoveOrCopyImageGroupCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 17:32:41,007 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDSCommand] (pool-3-thread-45) [5f139010] START, MoveImageGroupVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2, imageGroupId = fbf4b601-4a1f-4f61-aea6-a939b6287dce, dstDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, vmId = 00000000-0000-0000-0000-000000000000, op = Move, postZero = false, force = false), log id: 62ba8eef >2012-08-06 17:32:41,949 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDSCommand] (pool-3-thread-45) [5f139010] FINISH, MoveImageGroupVDSCommand, log id: 62ba8eef >2012-08-06 17:32:41,980 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-45) [5f139010] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity be99ddfd-e771-4322-a713-a67964393fb9 >2012-08-06 17:32:41,980 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-45) [5f139010] EntityMultiAsyncTasks::AttachTask: Attaching task 2e4d3b85-6079-49b9-8094-b3122df139e4 to entity be99ddfd-e771-4322-a713-a67964393fb9. >2012-08-06 17:32:41,999 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-45) [5f139010] Adding task 2e4d3b85-6079-49b9-8094-b3122df139e4 to DataBase >2012-08-06 17:32:42,039 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-45) [5f139010] Adding task 2e4d3b85-6079-49b9-8094-b3122df139e4 (Parent Command MoveOrCopyDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-08-06 17:32:42,098 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-45) [5f139010] Lock freed to object EngineLock [exclusiveLocks= key: fbf4b601-4a1f-4f61-aea6-a939b6287dce value: DISK >, sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 17:32:42,142 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-45) [5f139010] BaseAsyncTask::StartPollingTask: Starting to poll task 2e4d3b85-6079-49b9-8094-b3122df139e4. >2012-08-06 17:32:42,143 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-45) [5f139010] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity be99ddfd-e771-4322-a713-a67964393fb9 is MoveOrCopyDisk (determined by task 2e4d3b85-6079-49b9-8094-b3122df139e4) >2012-08-06 17:32:50,886 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-76) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2012-08-06 17:32:50,916 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-76) SPMAsyncTask::PollTask: Polling task 2e4d3b85-6079-49b9-8094-b3122df139e4 (Parent Command MoveOrCopyDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2012-08-06 17:32:50,917 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-76) Finished polling Tasks, will poll again in 10 seconds. >2012-08-06 17:34:41,279 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-48) SPMAsyncTask::PollTask: Polling task 2e4d3b85-6079-49b9-8094-b3122df139e4 (Parent Command MoveOrCopyDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-08-06 17:34:41,306 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-48) BaseAsyncTask::OnTaskEndSuccess: Task 2e4d3b85-6079-49b9-8094-b3122df139e4 (Parent Command MoveOrCopyDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-08-06 17:34:41,307 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-48) EntityAsyncTask::EndActionIfNecessary: All tasks of entity be99ddfd-e771-4322-a713-a67964393fb9 has ended -> executing EndAction >2012-08-06 17:34:41,308 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-48) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: be99ddfd-e771-4322-a713-a67964393fb9): calling EndAction for action type MoveOrCopyDisk. >2012-08-06 17:34:41,309 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::EndCommandAction [within thread]context: Attempting to EndAction MoveOrCopyDisk >2012-08-06 17:34:41,352 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-44) Ending command successfully: org.ovirt.engine.core.bll.MoveOrCopyDiskCommand >2012-08-06 17:34:41,354 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-44) START, GetImageInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, imageGroupId = fbf4b601-4a1f-4f61-aea6-a939b6287dce, imageId = be99ddfd-e771-4322-a713-a67964393fb9), log id: 598774c6 >2012-08-06 17:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable hosts >2012-08-06 17:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Autorecovering 0 hosts >2012-08-06 17:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable hosts done >2012-08-06 17:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable storage domains >2012-08-06 17:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Autorecovering 0 storage domains >2012-08-06 17:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable storage domains done >2012-08-06 17:35:10,147 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) domain 99bb665e-3421-4afb-bf70-d7b879c591b3 in problem. vds: purple-vds3 >2012-08-06 17:36:47,180 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-44) irsBroker::buildImageEntity::Failed building DIskImage >2012-08-06 17:36:47,184 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-44) Command org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand return value > >Class Name: org.ovirt.engine.core.vdsbroker.irsbroker.OneImageInfoReturnForXmlRpc >mInfo {status=INVALID, mtime=0, children=[Ljava.lang.Object;@4bbff377, truesize=0, apparentsize=0} >mStatus Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc >mCode 0 >mMessage OK > > >status = INVALID >mtime = 0 >children = [Ljava.lang.Object;@4bbff377 >truesize = 0 >apparentsize = 0 > >2012-08-06 17:36:47,195 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-44) candidate can not be null please use static method createGuidFromString: java.lang.NullPointerException: candidate can not be null please use static method createGuidFromString > at org.ovirt.engine.core.compat.NGuid.<init>(NGuid.java:44) [engine-compat.jar:] > at org.ovirt.engine.core.compat.Guid.<init>(Guid.java:24) [engine-compat.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand.buildImageEntity(GetImageInfoVDSCommand.java:80) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand.ExecuteIrsBrokerCommand(GetImageInfoVDSCommand.java:39) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand.ExecuteVDSCommand(IrsBrokerCommand.java:1520) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.ExecuteCommand(VDSCommandBase.java:60) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.Execute(VdcCommandBase.java:41) [engine-dal.jar:] > at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:390) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:1322) [engine-bll.jar:] > at org.ovirt.engine.core.bll.BaseImagesCommand.EndSuccessfully(BaseImagesCommand.java:361) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.InternalEndSuccessfully(CommandBase.java:475) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:430) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1258) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:168) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:107) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.EndAction(CommandBase.java:376) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.endAction(Backend.java:355) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.ovirt.engine.core.utils.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:11) [engine-utils.jar:] > at sun.reflect.GeneratedMethodAccessor57.invoke(Unknown Source) [:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.endAction(Unknown Source) [engine-bll.jar:] > at org.ovirt.engine.core.bll.EntityAsyncTask.EndCommandAction(EntityAsyncTask.java:134) [engine-bll.jar:] > at org.ovirt.engine.core.bll.EntityAsyncTask.access$000(EntityAsyncTask.java:23) [engine-bll.jar:] > at org.ovirt.engine.core.bll.EntityAsyncTask$1.run(EntityAsyncTask.java:104) [engine-bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 17:36:47,330 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-44) FINISH, GetImageInfoVDSCommand, log id: 598774c6 >2012-08-06 17:36:47,397 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type MoveOrCopyDisk completed, handling the result. >2012-08-06 17:36:47,401 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type MoveOrCopyDisk succeeded, clearing tasks. >2012-08-06 17:36:47,420 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 2e4d3b85-6079-49b9-8094-b3122df139e4 >2012-08-06 17:36:47,423 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) START, SPMClearTaskVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 2e4d3b85-6079-49b9-8094-b3122df139e4), log id: 12f28492 >2012-08-06 17:36:47,546 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) START, HSMClearTaskVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, taskId=2e4d3b85-6079-49b9-8094-b3122df139e4), log id: 4b13b063 >2012-08-06 17:36:47,581 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-44) FINISH, HSMClearTaskVDSCommand, log id: 4b13b063 >2012-08-06 17:36:47,581 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-44) FINISH, SPMClearTaskVDSCommand, log id: 12f28492 >2012-08-06 17:36:47,602 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-44) BaseAsyncTask::RemoveTaskFromDB: Removed task 2e4d3b85-6079-49b9-8094-b3122df139e4 from DataBase >2012-08-06 17:36:47,603 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-44) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity be99ddfd-e771-4322-a713-a67964393fb9 >2012-08-06 17:36:47,961 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-76) Setting new tasks map. The map contains now 0 tasks >2012-08-06 17:36:47,961 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-76) Cleared all tasks of pool 7a858a05-d5d9-40de-9a4e-c24b1980eb23. >2012-08-06 17:36:47,964 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-76) Could not find vds that is spm and non-operational. >2012-08-06 17:39:30,694 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (ajp--127.0.0.1-8009-16) Lock Acquired to object EngineLock [exclusiveLocks= key: fbf4b601-4a1f-4f61-aea6-a939b6287dce value: DISK >, sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 17:39:30,765 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (pool-3-thread-44) The message key MoveOrCopyDisk is missing from bundles/ExecutionMessages >2012-08-06 17:39:30,902 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-44) [1a813788] Running command: MoveOrCopyDiskCommand internal: false. Entities affected : ID: fbf4b601-4a1f-4f61-aea6-a939b6287dce Type: Disk >2012-08-06 17:39:30,906 INFO [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-44) [1a813788] Running command: MoveOrCopyImageGroupCommand internal: true. Entities affected : ID: 6eb052fb-6503-4d84-b053-62ed828dbbf2 Type: Storage >2012-08-06 17:39:30,912 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDSCommand] (pool-3-thread-44) [1a813788] START, MoveImageGroupVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, imageGroupId = fbf4b601-4a1f-4f61-aea6-a939b6287dce, dstDomainId = 6eb052fb-6503-4d84-b053-62ed828dbbf2, vmId = 00000000-0000-0000-0000-000000000000, op = Move, postZero = false, force = false), log id: 14c4ae6 >2012-08-06 17:39:30,966 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-44) [1a813788] Failed in MoveImageGroupVDS method >2012-08-06 17:39:30,967 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-44) [1a813788] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to MoveImageGroupVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 17:39:30,968 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-3-thread-44) [1a813788] IrsBroker::Failed::MoveImageGroupVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to MoveImageGroupVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 17:39:30,975 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDSCommand] (pool-3-thread-44) [1a813788] FINISH, MoveImageGroupVDSCommand, log id: 14c4ae6 >2012-08-06 17:39:30,978 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-44) [1a813788] Command org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to MoveImageGroupVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 17:39:30,987 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-3-thread-44) [1a813788] Transaction rolled-back for command: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand. >2012-08-06 17:39:30,991 INFO [org.ovirt.engine.core.bll.MoveOrCopyDiskCommand] (pool-3-thread-44) [1a813788] Lock freed to object EngineLock [exclusiveLocks= key: fbf4b601-4a1f-4f61-aea6-a939b6287dce value: DISK >, sharedLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >] >2012-08-06 17:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable hosts >2012-08-06 17:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Autorecovering 0 hosts >2012-08-06 17:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable hosts done >2012-08-06 17:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable storage domains >2012-08-06 17:40:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Autorecovering 0 storage domains >2012-08-06 17:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable storage domains done >2012-08-06 17:40:10,148 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) starting ProcessDomainRecovery for domain 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 17:40:10,152 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) domain 99bb665e-3421-4afb-bf70-d7b879c591b3 was reported by all hosts in status UP as problematic. Moving the Domain to NonOperational. >2012-08-06 17:40:10,175 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (QuartzScheduler_Worker-2) [c37a4bd] The message key HandleFailedStorageDomain is missing from bundles/ExecutionMessages >2012-08-06 17:40:10,265 INFO [org.ovirt.engine.core.bll.storage.HandleFailedStorageDomainCommand] (QuartzScheduler_Worker-2) [c37a4bd] Running command: HandleFailedStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 17:40:10,297 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (QuartzScheduler_Worker-2) [c37a4bd] Running command: DeactivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 17:40:10,331 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (QuartzScheduler_Worker-2) [c37a4bd] START, DeactivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 2), log id: 2d4eb268 >2012-08-06 17:40:11,029 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (QuartzScheduler_Worker-2) [c37a4bd] FINISH, DeactivateStorageDomainVDSCommand, log id: 2d4eb268 >2012-08-06 17:40:11,046 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (pool-3-thread-47) [c37a4bd] After deactivate treatment vds: purple-vds3,pool scsi >2012-08-06 17:40:11,093 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-3-thread-47) [c37a4bd] START, RefreshStoragePoolVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, masterStorageDomainId=6eb052fb-6503-4d84-b053-62ed828dbbf2, msterVersion=2), log id: 16558e85 >2012-08-06 17:40:13,214 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-3-thread-47) [c37a4bd] FINISH, RefreshStoragePoolVDSCommand, log id: 16558e85 >2012-08-06 17:40:13,236 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (QuartzScheduler_Worker-2) [c37a4bd] START, DisconnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 5ac37f50 >2012-08-06 17:40:14,036 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (QuartzScheduler_Worker-2) [c37a4bd] FINISH, DisconnectStorageServerVDSCommand, return: {b2cd73d6-cacf-402b-b327-8ec359c99001=0, d7f70e98-f2e9-44ba-b348-a0df8451fc68=0}, log id: 5ac37f50 >2012-08-06 17:40:14,088 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) [c37a4bd] No string for UNASSIGNED type. Use default Log >2012-08-06 17:43:07,191 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-10) DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 17:43:09,670 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp--127.0.0.1-8009-11) [74ffafd7] Running command: LogoutUserCommand internal: false. >2012-08-06 17:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Checking autorecoverable hosts >2012-08-06 17:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Autorecovering 0 hosts >2012-08-06 17:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Checking autorecoverable hosts done >2012-08-06 17:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Checking autorecoverable storage domains >2012-08-06 17:45:00,040 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Autorecovering 1 storage domains >2012-08-06 17:45:00,040 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 17:45:00,046 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [42a7a8dc] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 17:45:00,097 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [42a7a8dc] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 17:45:00,118 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [42a7a8dc] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 17:45:00,120 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [42a7a8dc] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 5:45 PM >2012-08-06 17:45:00,146 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [42a7a8dc] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 422aca76 >2012-08-06 17:48:00,153 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [42a7a8dc] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 17:48:00,160 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [42a7a8dc] FINISH, ConnectStorageServerVDSCommand, log id: 422aca76 >2012-08-06 17:48:00,166 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [42a7a8dc] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 17:48:00,199 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [42a7a8dc] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 5:48 PM >2012-08-06 17:48:00,200 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-12) [42a7a8dc] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 6bb60fcd >2012-08-06 17:48:00,466 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-12) [42a7a8dc] Failed in ActivateStorageDomainVDS method >2012-08-06 17:48:00,466 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-12) [42a7a8dc] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 17:48:00,468 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) [42a7a8dc] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 17:48:00,475 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-12) [42a7a8dc] FINISH, ActivateStorageDomainVDSCommand, log id: 6bb60fcd >2012-08-06 17:48:00,478 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [42a7a8dc] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 17:48:00,495 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [42a7a8dc] Command [id=ba1a5c44-c4ba-4c04-ad8b-f8c3e45c9c0a]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 17:48:00,520 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [42a7a8dc] Checking autorecoverable storage domains done >2012-08-06 17:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Checking autorecoverable hosts >2012-08-06 17:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Autorecovering 0 hosts >2012-08-06 17:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Checking autorecoverable hosts done >2012-08-06 17:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Checking autorecoverable storage domains >2012-08-06 17:50:00,022 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Autorecovering 1 storage domains >2012-08-06 17:50:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 17:50:00,029 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-64) [6af66fb0] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 17:50:00,135 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-64) [6af66fb0] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 17:50:00,169 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-64) [6af66fb0] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 17:50:00,173 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-64) [6af66fb0] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 5:50 PM >2012-08-06 17:50:00,190 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [6af66fb0] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 226d53b5 >2012-08-06 17:53:00,194 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [6af66fb0] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 17:53:00,198 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [6af66fb0] FINISH, ConnectStorageServerVDSCommand, log id: 226d53b5 >2012-08-06 17:53:00,203 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [6af66fb0] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 17:53:00,254 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-64) [6af66fb0] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 5:53 PM >2012-08-06 17:53:00,255 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-64) [6af66fb0] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 619e0d87 >2012-08-06 17:53:00,512 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-64) [6af66fb0] Failed in ActivateStorageDomainVDS method >2012-08-06 17:53:00,513 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-64) [6af66fb0] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 17:53:00,518 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-64) [6af66fb0] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 17:53:00,523 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-64) [6af66fb0] FINISH, ActivateStorageDomainVDSCommand, log id: 619e0d87 >2012-08-06 17:53:00,527 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-64) [6af66fb0] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 17:53:00,539 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-64) [6af66fb0] Command [id=806511f7-3721-47d0-b683-a6d6ae792caa]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 17:53:00,560 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [6af66fb0] Checking autorecoverable storage domains done >2012-08-06 17:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) Checking autorecoverable hosts >2012-08-06 17:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) Autorecovering 0 hosts >2012-08-06 17:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) Checking autorecoverable hosts done >2012-08-06 17:55:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) Checking autorecoverable storage domains >2012-08-06 17:55:00,031 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) Autorecovering 1 storage domains >2012-08-06 17:55:00,031 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 17:55:00,033 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [4f41d11b] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 17:55:00,076 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [4f41d11b] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 17:55:00,118 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [4f41d11b] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 17:55:00,119 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [4f41d11b] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 5:55 PM >2012-08-06 17:55:00,151 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [4f41d11b] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 133d20b2 >2012-08-06 17:58:00,158 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [4f41d11b] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 17:58:00,159 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [4f41d11b] FINISH, ConnectStorageServerVDSCommand, log id: 133d20b2 >2012-08-06 17:58:00,160 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [4f41d11b] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 17:58:00,190 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [4f41d11b] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 5:58 PM >2012-08-06 17:58:00,191 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-66) [4f41d11b] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: b1ef1c >2012-08-06 17:58:00,456 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-66) [4f41d11b] Failed in ActivateStorageDomainVDS method >2012-08-06 17:58:00,456 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-66) [4f41d11b] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 17:58:00,460 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-66) [4f41d11b] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 17:58:00,467 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-66) [4f41d11b] FINISH, ActivateStorageDomainVDSCommand, log id: b1ef1c >2012-08-06 17:58:00,471 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [4f41d11b] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 17:58:00,484 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [4f41d11b] Command [id=5689b4a5-686d-41c7-95ed-c5c8b7e6b3de]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 17:58:00,511 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [4f41d11b] Checking autorecoverable storage domains done >2012-08-06 18:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Checking autorecoverable hosts >2012-08-06 18:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Autorecovering 0 hosts >2012-08-06 18:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Checking autorecoverable hosts done >2012-08-06 18:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Checking autorecoverable storage domains >2012-08-06 18:00:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Autorecovering 1 storage domains >2012-08-06 18:00:00,025 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 18:00:00,029 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [632748ee] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:00:00,069 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [632748ee] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 18:00:00,089 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [632748ee] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:00:00,091 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [632748ee] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 6:00 PM >2012-08-06 18:00:00,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [632748ee] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 45a8603a >2012-08-06 18:03:00,111 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [632748ee] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 18:03:00,116 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [632748ee] FINISH, ConnectStorageServerVDSCommand, log id: 45a8603a >2012-08-06 18:03:00,121 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [632748ee] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 18:03:00,168 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [632748ee] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 6:03 PM >2012-08-06 18:03:00,169 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-16) [632748ee] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 70b6eea3 >2012-08-06 18:03:00,433 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-16) [632748ee] Failed in ActivateStorageDomainVDS method >2012-08-06 18:03:00,434 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-16) [632748ee] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:03:00,435 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [632748ee] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:03:00,442 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-16) [632748ee] FINISH, ActivateStorageDomainVDSCommand, log id: 70b6eea3 >2012-08-06 18:03:00,445 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [632748ee] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:03:00,461 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [632748ee] Command [id=f67bdd73-d734-4d5c-b1ee-9cf30d6f4ab8]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 18:03:00,485 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [632748ee] Checking autorecoverable storage domains done >2012-08-06 18:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable hosts >2012-08-06 18:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Autorecovering 0 hosts >2012-08-06 18:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable hosts done >2012-08-06 18:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Checking autorecoverable storage domains >2012-08-06 18:05:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Autorecovering 1 storage domains >2012-08-06 18:05:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 18:05:00,023 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-15) [3e63d602] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:05:00,057 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-15) [3e63d602] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 18:05:00,074 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-15) [3e63d602] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:05:00,079 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-15) [3e63d602] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 6:05 PM >2012-08-06 18:05:00,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [3e63d602] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 492e29bd >2012-08-06 18:08:00,105 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [3e63d602] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 18:08:00,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [3e63d602] FINISH, ConnectStorageServerVDSCommand, log id: 492e29bd >2012-08-06 18:08:00,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [3e63d602] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 18:08:00,174 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-15) [3e63d602] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 6:08 PM >2012-08-06 18:08:00,175 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-15) [3e63d602] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 7dcd5add >2012-08-06 18:08:00,445 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-15) [3e63d602] Failed in ActivateStorageDomainVDS method >2012-08-06 18:08:00,446 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-15) [3e63d602] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:08:00,447 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-15) [3e63d602] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:08:00,451 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-15) [3e63d602] FINISH, ActivateStorageDomainVDSCommand, log id: 7dcd5add >2012-08-06 18:08:00,454 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-15) [3e63d602] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:08:00,466 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-15) [3e63d602] Command [id=f16c2438-d550-46b4-87c2-ecd391b641ea]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 18:08:00,489 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) [3e63d602] Checking autorecoverable storage domains done >2012-08-06 18:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) Checking autorecoverable hosts >2012-08-06 18:10:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) Autorecovering 0 hosts >2012-08-06 18:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) Checking autorecoverable hosts done >2012-08-06 18:10:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) Checking autorecoverable storage domains >2012-08-06 18:10:00,035 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) Autorecovering 1 storage domains >2012-08-06 18:10:00,036 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 18:10:00,048 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-32) [6dd5a778] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:10:00,125 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-32) [6dd5a778] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 18:10:00,157 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-32) [6dd5a778] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:10:00,161 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-32) [6dd5a778] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 6:10 PM >2012-08-06 18:10:00,178 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [6dd5a778] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 91c9148 >2012-08-06 18:13:00,182 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [6dd5a778] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 18:13:00,184 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [6dd5a778] FINISH, ConnectStorageServerVDSCommand, log id: 91c9148 >2012-08-06 18:13:00,184 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [6dd5a778] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 18:13:00,217 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-32) [6dd5a778] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 6:13 PM >2012-08-06 18:13:00,218 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-32) [6dd5a778] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 58c07982 >2012-08-06 18:13:00,472 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-32) [6dd5a778] Failed in ActivateStorageDomainVDS method >2012-08-06 18:13:00,473 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-32) [6dd5a778] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:13:00,474 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [6dd5a778] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:13:00,482 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-32) [6dd5a778] FINISH, ActivateStorageDomainVDSCommand, log id: 58c07982 >2012-08-06 18:13:00,486 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-32) [6dd5a778] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:13:00,504 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-32) [6dd5a778] Command [id=9b88df22-25b7-4709-bf8b-7609aa06ac84]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 18:13:00,519 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) [6dd5a778] Checking autorecoverable storage domains done >2012-08-06 18:13:08,180 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp--127.0.0.1-8009-23) [7dfab8e] Running command: LogoutUserCommand internal: false. >2012-08-06 18:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Checking autorecoverable hosts >2012-08-06 18:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Autorecovering 0 hosts >2012-08-06 18:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Checking autorecoverable hosts done >2012-08-06 18:15:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Checking autorecoverable storage domains >2012-08-06 18:15:00,036 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Autorecovering 1 storage domains >2012-08-06 18:15:00,039 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 18:15:00,043 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [3b095c2] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:15:00,089 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [3b095c2] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 18:15:00,110 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [3b095c2] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:15:00,115 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [3b095c2] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 6:15 PM >2012-08-06 18:15:00,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [3b095c2] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 5098654e >2012-08-06 18:18:00,134 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [3b095c2] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 18:18:00,136 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [3b095c2] FINISH, ConnectStorageServerVDSCommand, log id: 5098654e >2012-08-06 18:18:00,136 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [3b095c2] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 18:18:00,167 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [3b095c2] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 6:18 PM >2012-08-06 18:18:00,168 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-72) [3b095c2] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 55452899 >2012-08-06 18:18:00,422 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-72) [3b095c2] Failed in ActivateStorageDomainVDS method >2012-08-06 18:18:00,423 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-72) [3b095c2] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:18:00,426 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-72) [3b095c2] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:18:00,434 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-72) [3b095c2] FINISH, ActivateStorageDomainVDSCommand, log id: 55452899 >2012-08-06 18:18:00,438 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [3b095c2] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:18:00,450 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [3b095c2] Command [id=bbbba834-86b3-45a1-8ef2-c0f4be29dbc6]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 18:18:00,474 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [3b095c2] Checking autorecoverable storage domains done >2012-08-06 18:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable hosts >2012-08-06 18:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Autorecovering 0 hosts >2012-08-06 18:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable hosts done >2012-08-06 18:20:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Checking autorecoverable storage domains >2012-08-06 18:20:00,025 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Autorecovering 1 storage domains >2012-08-06 18:20:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 18:20:00,028 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-68) [b706b45] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:20:00,075 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-68) [b706b45] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 18:20:00,095 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-68) [b706b45] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:20:00,099 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-68) [b706b45] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 6:20 PM >2012-08-06 18:20:00,116 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [b706b45] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 6e0032b7 >2012-08-06 18:23:00,120 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [b706b45] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 18:23:00,121 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [b706b45] FINISH, ConnectStorageServerVDSCommand, log id: 6e0032b7 >2012-08-06 18:23:00,123 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [b706b45] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 18:23:00,156 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-68) [b706b45] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 6:23 PM >2012-08-06 18:23:00,159 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-68) [b706b45] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 6b6e2caa >2012-08-06 18:23:00,425 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-68) [b706b45] Failed in ActivateStorageDomainVDS method >2012-08-06 18:23:00,426 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-68) [b706b45] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:23:00,428 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-68) [b706b45] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:23:00,437 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-68) [b706b45] FINISH, ActivateStorageDomainVDSCommand, log id: 6b6e2caa >2012-08-06 18:23:00,441 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-68) [b706b45] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:23:00,452 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-68) [b706b45] Command [id=126ac797-78c6-49c7-8f46-1d85a8170168]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 18:23:00,481 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) [b706b45] Checking autorecoverable storage domains done >2012-08-06 18:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts >2012-08-06 18:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering 0 hosts >2012-08-06 18:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts done >2012-08-06 18:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable storage domains >2012-08-06 18:25:00,065 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering 1 storage domains >2012-08-06 18:25:00,067 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 18:25:00,072 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [6efe2887] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:25:00,114 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [6efe2887] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 18:25:00,139 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [6efe2887] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:25:00,143 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [6efe2887] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 6:25 PM >2012-08-06 18:25:00,159 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [6efe2887] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 3024b07b >2012-08-06 18:28:00,163 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [6efe2887] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 18:28:00,166 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [6efe2887] FINISH, ConnectStorageServerVDSCommand, log id: 3024b07b >2012-08-06 18:28:00,171 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [6efe2887] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 18:28:00,214 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [6efe2887] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 6:28 PM >2012-08-06 18:28:00,215 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-9) [6efe2887] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: e5bf068 >2012-08-06 18:28:00,495 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-9) [6efe2887] Failed in ActivateStorageDomainVDS method >2012-08-06 18:28:00,496 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-9) [6efe2887] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:28:00,497 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-9) [6efe2887] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:28:00,500 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-9) [6efe2887] FINISH, ActivateStorageDomainVDSCommand, log id: e5bf068 >2012-08-06 18:28:00,503 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [6efe2887] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:28:00,515 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [6efe2887] Command [id=67f5cfb5-22a8-4721-8c69-da98894797c8]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 18:28:00,586 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) [6efe2887] Checking autorecoverable storage domains done >2012-08-06 18:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) Checking autorecoverable hosts >2012-08-06 18:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) Autorecovering 0 hosts >2012-08-06 18:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) Checking autorecoverable hosts done >2012-08-06 18:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) Checking autorecoverable storage domains >2012-08-06 18:30:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) Autorecovering 1 storage domains >2012-08-06 18:30:00,029 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 18:30:00,034 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [7b8f3799] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:30:00,092 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [7b8f3799] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 18:30:00,119 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [7b8f3799] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:30:00,124 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [7b8f3799] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 6:30 PM >2012-08-06 18:30:00,143 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [7b8f3799] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 2627a50a >2012-08-06 18:33:00,148 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [7b8f3799] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 18:33:00,149 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [7b8f3799] FINISH, ConnectStorageServerVDSCommand, log id: 2627a50a >2012-08-06 18:33:00,150 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [7b8f3799] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 18:33:00,179 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [7b8f3799] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 6:33 PM >2012-08-06 18:33:00,182 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-27) [7b8f3799] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 55958b50 >2012-08-06 18:33:00,436 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-27) [7b8f3799] Failed in ActivateStorageDomainVDS method >2012-08-06 18:33:00,436 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-27) [7b8f3799] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:33:00,439 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [7b8f3799] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:33:00,446 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-27) [7b8f3799] FINISH, ActivateStorageDomainVDSCommand, log id: 55958b50 >2012-08-06 18:33:00,450 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [7b8f3799] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:33:00,466 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [7b8f3799] Command [id=45a46d54-092c-49a1-9f72-4a1ecb539ab3]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 18:33:00,494 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [7b8f3799] Checking autorecoverable storage domains done >2012-08-06 18:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) [6dd5a778] Checking autorecoverable hosts >2012-08-06 18:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) [6dd5a778] Autorecovering 0 hosts >2012-08-06 18:35:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) [6dd5a778] Checking autorecoverable hosts done >2012-08-06 18:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) [6dd5a778] Checking autorecoverable storage domains >2012-08-06 18:35:00,039 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) [6dd5a778] Autorecovering 1 storage domains >2012-08-06 18:35:00,042 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) [6dd5a778] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 18:35:00,047 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-32) [125f47e3] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:35:00,086 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-32) [125f47e3] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 18:35:00,109 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-32) [125f47e3] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:35:00,110 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-32) [125f47e3] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 6:35 PM >2012-08-06 18:35:00,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [125f47e3] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 369ce8b7 >2012-08-06 18:38:00,127 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [125f47e3] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 18:38:00,130 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [125f47e3] FINISH, ConnectStorageServerVDSCommand, log id: 369ce8b7 >2012-08-06 18:38:00,133 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [125f47e3] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 18:38:00,164 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-32) [125f47e3] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 6:38 PM >2012-08-06 18:38:00,166 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-32) [125f47e3] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 6f0467ff >2012-08-06 18:38:00,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-32) [125f47e3] Failed in ActivateStorageDomainVDS method >2012-08-06 18:38:00,420 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-32) [125f47e3] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:38:00,422 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [125f47e3] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:38:00,429 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-32) [125f47e3] FINISH, ActivateStorageDomainVDSCommand, log id: 6f0467ff >2012-08-06 18:38:00,433 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-32) [125f47e3] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:38:00,444 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-32) [125f47e3] Command [id=6436db33-b10d-437f-b605-1838c13b72fb]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 18:38:00,475 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) [125f47e3] Checking autorecoverable storage domains done >2012-08-06 18:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Checking autorecoverable hosts >2012-08-06 18:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Autorecovering 0 hosts >2012-08-06 18:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Checking autorecoverable hosts done >2012-08-06 18:40:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Checking autorecoverable storage domains >2012-08-06 18:40:00,030 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Autorecovering 1 storage domains >2012-08-06 18:40:00,031 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 18:40:00,038 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [291da5cc] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:40:00,086 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [291da5cc] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 18:40:00,109 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [291da5cc] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:40:00,117 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [291da5cc] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 6:40 PM >2012-08-06 18:40:00,141 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [291da5cc] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 2a752be5 >2012-08-06 18:43:00,145 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [291da5cc] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 18:43:00,146 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [291da5cc] FINISH, ConnectStorageServerVDSCommand, log id: 2a752be5 >2012-08-06 18:43:00,148 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [291da5cc] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 18:43:00,198 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [291da5cc] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 6:43 PM >2012-08-06 18:43:00,199 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-41) [291da5cc] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 29622304 >2012-08-06 18:43:00,533 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-41) [291da5cc] Failed in ActivateStorageDomainVDS method >2012-08-06 18:43:00,534 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-41) [291da5cc] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:43:00,536 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) [291da5cc] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:43:00,544 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-41) [291da5cc] FINISH, ActivateStorageDomainVDSCommand, log id: 29622304 >2012-08-06 18:43:00,547 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [291da5cc] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:43:00,564 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [291da5cc] Command [id=6b48717c-b6b5-4ad9-86c5-27fefb843cf1]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 18:43:00,589 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [291da5cc] Checking autorecoverable storage domains done >2012-08-06 18:43:07,298 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-8) DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 18:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable hosts >2012-08-06 18:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Autorecovering 0 hosts >2012-08-06 18:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable hosts done >2012-08-06 18:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable storage domains >2012-08-06 18:45:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Autorecovering 1 storage domains >2012-08-06 18:45:00,034 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 18:45:00,041 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-86) [3ee4a5fe] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:45:00,101 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-86) [3ee4a5fe] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 18:45:00,155 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-86) [3ee4a5fe] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:45:00,159 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-86) [3ee4a5fe] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 6:45 PM >2012-08-06 18:45:00,175 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [3ee4a5fe] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 735a3b42 >2012-08-06 18:48:00,179 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [3ee4a5fe] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 18:48:00,180 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [3ee4a5fe] FINISH, ConnectStorageServerVDSCommand, log id: 735a3b42 >2012-08-06 18:48:00,181 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [3ee4a5fe] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 18:48:00,213 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-86) [3ee4a5fe] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 6:48 PM >2012-08-06 18:48:00,214 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-86) [3ee4a5fe] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 2a82028f >2012-08-06 18:48:00,493 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-86) [3ee4a5fe] Failed in ActivateStorageDomainVDS method >2012-08-06 18:48:00,494 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-86) [3ee4a5fe] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:48:00,495 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-86) [3ee4a5fe] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:48:00,502 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-86) [3ee4a5fe] FINISH, ActivateStorageDomainVDSCommand, log id: 2a82028f >2012-08-06 18:48:00,505 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-86) [3ee4a5fe] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:48:00,518 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-86) [3ee4a5fe] Command [id=65d697af-7c63-418c-9e48-2e63237b0460]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 18:48:00,544 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) [3ee4a5fe] Checking autorecoverable storage domains done >2012-08-06 18:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Checking autorecoverable hosts >2012-08-06 18:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Autorecovering 0 hosts >2012-08-06 18:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Checking autorecoverable hosts done >2012-08-06 18:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Checking autorecoverable storage domains >2012-08-06 18:50:00,035 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Autorecovering 1 storage domains >2012-08-06 18:50:00,038 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 18:50:00,042 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-91) [362558b5] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:50:00,096 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-91) [362558b5] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 18:50:00,131 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-91) [362558b5] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:50:00,135 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-91) [362558b5] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 6:50 PM >2012-08-06 18:50:00,151 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [362558b5] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 79618196 >2012-08-06 18:53:00,157 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [362558b5] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 18:53:00,158 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [362558b5] FINISH, ConnectStorageServerVDSCommand, log id: 79618196 >2012-08-06 18:53:00,159 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [362558b5] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 18:53:00,197 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-91) [362558b5] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 6:53 PM >2012-08-06 18:53:00,198 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-91) [362558b5] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 1d298c07 >2012-08-06 18:53:00,452 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-91) [362558b5] Failed in ActivateStorageDomainVDS method >2012-08-06 18:53:00,453 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-91) [362558b5] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:53:00,455 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-91) [362558b5] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:53:00,463 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-91) [362558b5] FINISH, ActivateStorageDomainVDSCommand, log id: 1d298c07 >2012-08-06 18:53:00,466 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-91) [362558b5] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:53:00,482 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-91) [362558b5] Command [id=0aae6110-cbb2-4a8a-936f-0e9fbe7fb010]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 18:53:00,548 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [362558b5] Checking autorecoverable storage domains done >2012-08-06 18:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [7b8f3799] Checking autorecoverable hosts >2012-08-06 18:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [7b8f3799] Autorecovering 0 hosts >2012-08-06 18:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [7b8f3799] Checking autorecoverable hosts done >2012-08-06 18:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [7b8f3799] Checking autorecoverable storage domains >2012-08-06 18:55:00,034 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [7b8f3799] Autorecovering 1 storage domains >2012-08-06 18:55:00,036 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [7b8f3799] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 18:55:00,041 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [fc9c427] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:55:00,096 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [fc9c427] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 18:55:00,121 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [fc9c427] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 18:55:00,126 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [fc9c427] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 6:55 PM >2012-08-06 18:55:00,142 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [fc9c427] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 21996b14 >2012-08-06 18:58:00,146 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [fc9c427] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 18:58:00,147 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [fc9c427] FINISH, ConnectStorageServerVDSCommand, log id: 21996b14 >2012-08-06 18:58:00,147 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [fc9c427] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 18:58:00,189 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [fc9c427] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 6:58 PM >2012-08-06 18:58:00,190 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-27) [fc9c427] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 5947d2d7 >2012-08-06 18:58:00,463 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-27) [fc9c427] Failed in ActivateStorageDomainVDS method >2012-08-06 18:58:00,464 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-27) [fc9c427] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:58:00,465 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [fc9c427] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:58:00,472 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-27) [fc9c427] FINISH, ActivateStorageDomainVDSCommand, log id: 5947d2d7 >2012-08-06 18:58:00,475 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [fc9c427] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 18:58:00,491 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [fc9c427] Command [id=8edd1522-c6f4-46c1-801a-02eddd826f81]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 18:58:00,511 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [fc9c427] Checking autorecoverable storage domains done >2012-08-06 19:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Checking autorecoverable hosts >2012-08-06 19:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Autorecovering 0 hosts >2012-08-06 19:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Checking autorecoverable hosts done >2012-08-06 19:00:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Checking autorecoverable storage domains >2012-08-06 19:00:00,046 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Autorecovering 1 storage domains >2012-08-06 19:00:00,049 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 19:00:00,054 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-60) [54670533] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:00:00,120 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-60) [54670533] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 19:00:00,146 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-60) [54670533] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:00:00,156 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-60) [54670533] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 7:00 PM >2012-08-06 19:00:00,179 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [54670533] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 414a8e5a >2012-08-06 19:03:00,184 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [54670533] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 19:03:00,185 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [54670533] FINISH, ConnectStorageServerVDSCommand, log id: 414a8e5a >2012-08-06 19:03:00,186 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [54670533] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 19:03:00,218 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-60) [54670533] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 7:03 PM >2012-08-06 19:03:00,219 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-60) [54670533] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 41b5fc12 >2012-08-06 19:03:00,474 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-60) [54670533] Failed in ActivateStorageDomainVDS method >2012-08-06 19:03:00,475 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-60) [54670533] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:03:00,476 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-60) [54670533] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:03:00,489 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-60) [54670533] FINISH, ActivateStorageDomainVDSCommand, log id: 41b5fc12 >2012-08-06 19:03:00,493 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-60) [54670533] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:03:00,509 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-60) [54670533] Command [id=3e418ad8-1e88-4b67-ad89-751c9a715343]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 19:03:00,548 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) [54670533] Checking autorecoverable storage domains done >2012-08-06 19:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [4f41d11b] Checking autorecoverable hosts >2012-08-06 19:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [4f41d11b] Autorecovering 0 hosts >2012-08-06 19:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [4f41d11b] Checking autorecoverable hosts done >2012-08-06 19:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [4f41d11b] Checking autorecoverable storage domains >2012-08-06 19:05:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [4f41d11b] Autorecovering 1 storage domains >2012-08-06 19:05:00,030 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [4f41d11b] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 19:05:00,035 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [7e7ff5b0] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:05:00,101 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [7e7ff5b0] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 19:05:00,125 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [7e7ff5b0] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:05:00,130 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [7e7ff5b0] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 7:05 PM >2012-08-06 19:05:00,150 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [7e7ff5b0] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 4515ade5 >2012-08-06 19:08:00,158 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [7e7ff5b0] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 19:08:00,160 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [7e7ff5b0] FINISH, ConnectStorageServerVDSCommand, log id: 4515ade5 >2012-08-06 19:08:00,164 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [7e7ff5b0] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 19:08:00,196 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [7e7ff5b0] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 7:08 PM >2012-08-06 19:08:00,198 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-66) [7e7ff5b0] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 5e2c1533 >2012-08-06 19:08:00,458 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-66) [7e7ff5b0] Failed in ActivateStorageDomainVDS method >2012-08-06 19:08:00,458 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-66) [7e7ff5b0] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:08:00,460 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-66) [7e7ff5b0] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:08:00,466 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-66) [7e7ff5b0] FINISH, ActivateStorageDomainVDSCommand, log id: 5e2c1533 >2012-08-06 19:08:00,472 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [7e7ff5b0] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:08:00,484 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [7e7ff5b0] Command [id=fbeae193-80a0-44d1-86a6-1de9e4ec032e]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 19:08:00,505 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [7e7ff5b0] Checking autorecoverable storage domains done >2012-08-06 19:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) [3ee4a5fe] Checking autorecoverable hosts >2012-08-06 19:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) [3ee4a5fe] Autorecovering 0 hosts >2012-08-06 19:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) [3ee4a5fe] Checking autorecoverable hosts done >2012-08-06 19:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) [3ee4a5fe] Checking autorecoverable storage domains >2012-08-06 19:10:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) [3ee4a5fe] Autorecovering 1 storage domains >2012-08-06 19:10:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) [3ee4a5fe] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 19:10:00,033 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-86) [7f96efc] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:10:00,074 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-86) [7f96efc] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 19:10:00,095 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-86) [7f96efc] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:10:00,099 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-86) [7f96efc] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 7:10 PM >2012-08-06 19:10:00,115 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [7f96efc] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 27e3bd7d >2012-08-06 19:13:00,119 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [7f96efc] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 19:13:00,120 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [7f96efc] FINISH, ConnectStorageServerVDSCommand, log id: 27e3bd7d >2012-08-06 19:13:00,120 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [7f96efc] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 19:13:00,156 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-86) [7f96efc] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 7:13 PM >2012-08-06 19:13:00,157 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-86) [7f96efc] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 324f125c >2012-08-06 19:13:00,452 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-86) [7f96efc] Failed in ActivateStorageDomainVDS method >2012-08-06 19:13:00,452 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-86) [7f96efc] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:13:00,454 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-86) [7f96efc] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:13:00,459 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-86) [7f96efc] FINISH, ActivateStorageDomainVDSCommand, log id: 324f125c >2012-08-06 19:13:00,463 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-86) [7f96efc] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:13:00,481 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-86) [7f96efc] Command [id=a7b378d9-84eb-4279-b906-c9931c1c8e02]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 19:13:00,525 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) [7f96efc] Checking autorecoverable storage domains done >2012-08-06 19:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [28b7172b] Checking autorecoverable hosts >2012-08-06 19:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [28b7172b] Autorecovering 0 hosts >2012-08-06 19:15:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [28b7172b] Checking autorecoverable hosts done >2012-08-06 19:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [28b7172b] Checking autorecoverable storage domains >2012-08-06 19:15:00,033 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [28b7172b] Autorecovering 1 storage domains >2012-08-06 19:15:00,034 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [28b7172b] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 19:15:00,043 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [1ee84146] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:15:00,135 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [1ee84146] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 19:15:00,170 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [1ee84146] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:15:00,174 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [1ee84146] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 7:15 PM >2012-08-06 19:15:00,192 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [1ee84146] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 14ca288 >2012-08-06 19:18:00,196 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [1ee84146] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 19:18:00,197 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [1ee84146] FINISH, ConnectStorageServerVDSCommand, log id: 14ca288 >2012-08-06 19:18:00,198 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [1ee84146] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 19:18:00,248 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [1ee84146] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 7:18 PM >2012-08-06 19:18:00,249 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-54) [1ee84146] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 618ea473 >2012-08-06 19:18:00,504 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-54) [1ee84146] Failed in ActivateStorageDomainVDS method >2012-08-06 19:18:00,505 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-54) [1ee84146] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:18:00,506 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-54) [1ee84146] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:18:00,513 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-54) [1ee84146] FINISH, ActivateStorageDomainVDSCommand, log id: 618ea473 >2012-08-06 19:18:00,517 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [1ee84146] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:18:00,533 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [1ee84146] Command [id=18054146-3ef1-4ffe-8057-77aabc4d93b3]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 19:18:00,563 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [1ee84146] Checking autorecoverable storage domains done >2012-08-06 19:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-28) Checking autorecoverable hosts >2012-08-06 19:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-28) Autorecovering 0 hosts >2012-08-06 19:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-28) Checking autorecoverable hosts done >2012-08-06 19:20:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-28) Checking autorecoverable storage domains >2012-08-06 19:20:00,047 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-28) Autorecovering 1 storage domains >2012-08-06 19:20:00,048 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-28) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 19:20:00,051 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-28) [5cc0f88d] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:20:00,135 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-28) [5cc0f88d] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 19:20:00,153 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-28) [5cc0f88d] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:20:00,158 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-28) [5cc0f88d] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 7:20 PM >2012-08-06 19:20:00,175 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [5cc0f88d] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 3de61af6 >2012-08-06 19:23:00,179 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [5cc0f88d] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 19:23:00,180 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [5cc0f88d] FINISH, ConnectStorageServerVDSCommand, log id: 3de61af6 >2012-08-06 19:23:00,180 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [5cc0f88d] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 19:23:00,207 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-28) [5cc0f88d] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 7:23 PM >2012-08-06 19:23:00,208 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-28) [5cc0f88d] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 1b94e467 >2012-08-06 19:23:00,463 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-28) [5cc0f88d] Failed in ActivateStorageDomainVDS method >2012-08-06 19:23:00,464 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-28) [5cc0f88d] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:23:00,465 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-28) [5cc0f88d] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:23:00,479 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-28) [5cc0f88d] FINISH, ActivateStorageDomainVDSCommand, log id: 1b94e467 >2012-08-06 19:23:00,483 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-28) [5cc0f88d] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:23:00,519 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-28) [5cc0f88d] Command [id=66c68101-493e-4725-8290-6c02b16ed831]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 19:23:00,577 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-28) [5cc0f88d] Checking autorecoverable storage domains done >2012-08-06 19:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable hosts >2012-08-06 19:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Autorecovering 0 hosts >2012-08-06 19:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable hosts done >2012-08-06 19:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable storage domains >2012-08-06 19:25:00,048 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Autorecovering 1 storage domains >2012-08-06 19:25:00,050 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 19:25:00,055 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [243a5a65] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:25:00,097 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [243a5a65] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 19:25:00,114 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [243a5a65] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:25:00,118 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [243a5a65] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 7:25 PM >2012-08-06 19:25:00,143 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [243a5a65] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 23c71a1e >2012-08-06 19:28:00,153 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [243a5a65] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 19:28:00,154 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [243a5a65] FINISH, ConnectStorageServerVDSCommand, log id: 23c71a1e >2012-08-06 19:28:00,156 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [243a5a65] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 19:28:00,190 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [243a5a65] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 7:28 PM >2012-08-06 19:28:00,191 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-37) [243a5a65] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 19b48060 >2012-08-06 19:28:00,442 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-37) [243a5a65] Failed in ActivateStorageDomainVDS method >2012-08-06 19:28:00,443 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-37) [243a5a65] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:28:00,446 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-37) [243a5a65] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:28:00,454 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-37) [243a5a65] FINISH, ActivateStorageDomainVDSCommand, log id: 19b48060 >2012-08-06 19:28:00,457 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [243a5a65] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:28:00,469 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [243a5a65] Command [id=9052f272-c979-41eb-8df1-ff7cb59ce151]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 19:28:00,490 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [243a5a65] Checking autorecoverable storage domains done >2012-08-06 19:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Checking autorecoverable hosts >2012-08-06 19:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Autorecovering 0 hosts >2012-08-06 19:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Checking autorecoverable hosts done >2012-08-06 19:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Checking autorecoverable storage domains >2012-08-06 19:30:00,040 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Autorecovering 1 storage domains >2012-08-06 19:30:00,043 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 19:30:00,047 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-44) [3dcf7973] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:30:00,115 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-44) [3dcf7973] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 19:30:00,151 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-44) [3dcf7973] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:30:00,161 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-44) [3dcf7973] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 7:30 PM >2012-08-06 19:30:00,183 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [3dcf7973] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 9f8d069 >2012-08-06 19:33:00,186 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [3dcf7973] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 19:33:00,187 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [3dcf7973] FINISH, ConnectStorageServerVDSCommand, log id: 9f8d069 >2012-08-06 19:33:00,188 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [3dcf7973] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 19:33:00,217 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-44) [3dcf7973] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 7:33 PM >2012-08-06 19:33:00,218 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-44) [3dcf7973] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 7d27d223 >2012-08-06 19:33:00,473 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-44) [3dcf7973] Failed in ActivateStorageDomainVDS method >2012-08-06 19:33:00,474 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-44) [3dcf7973] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:33:00,476 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) [3dcf7973] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:33:00,484 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-44) [3dcf7973] FINISH, ActivateStorageDomainVDSCommand, log id: 7d27d223 >2012-08-06 19:33:00,488 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-44) [3dcf7973] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:33:00,504 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-44) [3dcf7973] Command [id=f04dbfb5-8472-4cce-8070-50bce1d2d75c]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 19:33:00,531 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) [3dcf7973] Checking autorecoverable storage domains done >2012-08-06 19:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Checking autorecoverable hosts >2012-08-06 19:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Autorecovering 0 hosts >2012-08-06 19:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Checking autorecoverable hosts done >2012-08-06 19:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Checking autorecoverable storage domains >2012-08-06 19:35:00,066 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Autorecovering 1 storage domains >2012-08-06 19:35:00,066 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 19:35:00,069 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-3) [32e754a1] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:35:00,127 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-3) [32e754a1] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 19:35:00,150 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-3) [32e754a1] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:35:00,151 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-3) [32e754a1] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 7:35 PM >2012-08-06 19:35:00,178 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [32e754a1] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 6cf958e1 >2012-08-06 19:38:00,184 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [32e754a1] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 19:38:00,185 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [32e754a1] FINISH, ConnectStorageServerVDSCommand, log id: 6cf958e1 >2012-08-06 19:38:00,186 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [32e754a1] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 19:38:00,217 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-3) [32e754a1] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 7:38 PM >2012-08-06 19:38:00,219 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-3) [32e754a1] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 7093c6f7 >2012-08-06 19:38:00,474 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-3) [32e754a1] Failed in ActivateStorageDomainVDS method >2012-08-06 19:38:00,475 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-3) [32e754a1] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:38:00,479 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-3) [32e754a1] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:38:00,491 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-3) [32e754a1] FINISH, ActivateStorageDomainVDSCommand, log id: 7093c6f7 >2012-08-06 19:38:00,498 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-3) [32e754a1] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:38:00,516 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-3) [32e754a1] Command [id=1575d68b-3cf7-4716-a685-1fc471c5d61a]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 19:38:00,537 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) [32e754a1] Checking autorecoverable storage domains done >2012-08-06 19:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Checking autorecoverable hosts >2012-08-06 19:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Autorecovering 0 hosts >2012-08-06 19:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Checking autorecoverable hosts done >2012-08-06 19:40:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Checking autorecoverable storage domains >2012-08-06 19:40:00,029 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Autorecovering 1 storage domains >2012-08-06 19:40:00,031 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 19:40:00,036 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-10) [3f9e331a] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:40:00,140 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-10) [3f9e331a] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 19:40:00,189 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-10) [3f9e331a] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:40:00,190 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-10) [3f9e331a] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 7:40 PM >2012-08-06 19:40:00,204 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [3f9e331a] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 5ea9076 >2012-08-06 19:43:00,208 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [3f9e331a] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 19:43:00,209 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [3f9e331a] FINISH, ConnectStorageServerVDSCommand, log id: 5ea9076 >2012-08-06 19:43:00,214 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [3f9e331a] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 19:43:00,260 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-10) [3f9e331a] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 7:43 PM >2012-08-06 19:43:00,261 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-10) [3f9e331a] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 186113f1 >2012-08-06 19:43:00,552 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-10) [3f9e331a] Failed in ActivateStorageDomainVDS method >2012-08-06 19:43:00,553 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-10) [3f9e331a] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:43:00,557 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) [3f9e331a] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:43:00,564 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-10) [3f9e331a] FINISH, ActivateStorageDomainVDSCommand, log id: 186113f1 >2012-08-06 19:43:00,572 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-10) [3f9e331a] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:43:00,594 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-10) [3f9e331a] Command [id=f9720168-748c-4947-ba25-5579a8f6a0ab]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 19:43:00,646 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) [3f9e331a] Checking autorecoverable storage domains done >2012-08-06 19:43:07,302 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-67) [13d55ad0] DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 19:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Checking autorecoverable hosts >2012-08-06 19:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Autorecovering 0 hosts >2012-08-06 19:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Checking autorecoverable hosts done >2012-08-06 19:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Checking autorecoverable storage domains >2012-08-06 19:45:00,049 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Autorecovering 1 storage domains >2012-08-06 19:45:00,051 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 19:45:00,056 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [764ba3c5] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:45:00,107 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [764ba3c5] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 19:45:00,140 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [764ba3c5] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:45:00,141 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [764ba3c5] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 7:45 PM >2012-08-06 19:45:00,155 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [764ba3c5] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 4b1f5b31 >2012-08-06 19:48:00,159 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [764ba3c5] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 19:48:00,160 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [764ba3c5] FINISH, ConnectStorageServerVDSCommand, log id: 4b1f5b31 >2012-08-06 19:48:00,161 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [764ba3c5] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 19:48:00,194 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [764ba3c5] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 7:48 PM >2012-08-06 19:48:00,195 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-23) [764ba3c5] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 2a2ca2fb >2012-08-06 19:48:00,448 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-23) [764ba3c5] Failed in ActivateStorageDomainVDS method >2012-08-06 19:48:00,448 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-23) [764ba3c5] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:48:00,450 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) [764ba3c5] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:48:00,456 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-23) [764ba3c5] FINISH, ActivateStorageDomainVDSCommand, log id: 2a2ca2fb >2012-08-06 19:48:00,460 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [764ba3c5] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:48:00,493 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [764ba3c5] Command [id=abb6962a-61c4-463c-b943-209fdc05af7c]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 19:48:00,541 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) [764ba3c5] Checking autorecoverable storage domains done >2012-08-06 19:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable hosts >2012-08-06 19:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Autorecovering 0 hosts >2012-08-06 19:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable hosts done >2012-08-06 19:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable storage domains >2012-08-06 19:50:00,059 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Autorecovering 1 storage domains >2012-08-06 19:50:00,061 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 19:50:00,066 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [18a11d58] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:50:00,110 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [18a11d58] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 19:50:00,133 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [18a11d58] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:50:00,138 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [18a11d58] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 7:50 PM >2012-08-06 19:50:00,154 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [18a11d58] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 28bf3494 >2012-08-06 19:53:00,160 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [18a11d58] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 19:53:00,163 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [18a11d58] FINISH, ConnectStorageServerVDSCommand, log id: 28bf3494 >2012-08-06 19:53:00,166 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [18a11d58] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 19:53:00,198 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [18a11d58] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 7:53 PM >2012-08-06 19:53:00,199 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-79) [18a11d58] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: b0957a2 >2012-08-06 19:53:00,457 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-79) [18a11d58] Failed in ActivateStorageDomainVDS method >2012-08-06 19:53:00,458 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-79) [18a11d58] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:53:00,461 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-79) [18a11d58] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:53:00,469 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-79) [18a11d58] FINISH, ActivateStorageDomainVDSCommand, log id: b0957a2 >2012-08-06 19:53:00,473 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [18a11d58] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:53:00,491 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [18a11d58] Command [id=59e217db-fa7c-45bf-ae2a-1a2b7e4ce4e7]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 19:53:00,515 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) [18a11d58] Checking autorecoverable storage domains done >2012-08-06 19:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Checking autorecoverable hosts >2012-08-06 19:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Autorecovering 0 hosts >2012-08-06 19:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Checking autorecoverable hosts done >2012-08-06 19:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Checking autorecoverable storage domains >2012-08-06 19:55:00,072 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Autorecovering 1 storage domains >2012-08-06 19:55:00,074 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 19:55:00,080 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-89) [44f3adb7] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:55:00,154 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-89) [44f3adb7] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 19:55:00,182 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-89) [44f3adb7] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 19:55:00,186 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-89) [44f3adb7] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 7:55 PM >2012-08-06 19:55:00,202 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [44f3adb7] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 797750da >2012-08-06 19:58:00,206 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [44f3adb7] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 19:58:00,207 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [44f3adb7] FINISH, ConnectStorageServerVDSCommand, log id: 797750da >2012-08-06 19:58:00,208 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [44f3adb7] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 19:58:00,242 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-89) [44f3adb7] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 7:58 PM >2012-08-06 19:58:00,243 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-89) [44f3adb7] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 6669177b >2012-08-06 19:58:00,495 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-89) [44f3adb7] Failed in ActivateStorageDomainVDS method >2012-08-06 19:58:00,496 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-89) [44f3adb7] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:58:00,498 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-89) [44f3adb7] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:58:00,506 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-89) [44f3adb7] FINISH, ActivateStorageDomainVDSCommand, log id: 6669177b >2012-08-06 19:58:00,510 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-89) [44f3adb7] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 19:58:00,521 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-89) [44f3adb7] Command [id=91c5e8f0-8622-4a37-b93e-a0c78d308090]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 19:58:00,545 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) [44f3adb7] Checking autorecoverable storage domains done >2012-08-06 20:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [c37a4bd] Checking autorecoverable hosts >2012-08-06 20:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [c37a4bd] Autorecovering 0 hosts >2012-08-06 20:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [c37a4bd] Checking autorecoverable hosts done >2012-08-06 20:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [c37a4bd] Checking autorecoverable storage domains >2012-08-06 20:00:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [c37a4bd] Autorecovering 1 storage domains >2012-08-06 20:00:00,030 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [c37a4bd] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 20:00:00,035 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [56fd5402] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:00:00,079 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [56fd5402] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 20:00:00,098 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [56fd5402] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:00:00,100 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [56fd5402] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 8:00 PM >2012-08-06 20:00:00,125 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [56fd5402] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 930656f >2012-08-06 20:03:00,133 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [56fd5402] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 20:03:00,135 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [56fd5402] FINISH, ConnectStorageServerVDSCommand, log id: 930656f >2012-08-06 20:03:00,135 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [56fd5402] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 20:03:00,165 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [56fd5402] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 8:03 PM >2012-08-06 20:03:00,166 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-2) [56fd5402] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 798c99d >2012-08-06 20:03:00,421 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-2) [56fd5402] Failed in ActivateStorageDomainVDS method >2012-08-06 20:03:00,421 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-2) [56fd5402] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:03:00,422 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [56fd5402] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:03:00,438 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-2) [56fd5402] FINISH, ActivateStorageDomainVDSCommand, log id: 798c99d >2012-08-06 20:03:00,442 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [56fd5402] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:03:00,464 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [56fd5402] Command [id=e301f584-b08f-4c19-88af-65d87877e06f]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 20:03:00,494 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [56fd5402] Checking autorecoverable storage domains done >2012-08-06 20:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable hosts >2012-08-06 20:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Autorecovering 0 hosts >2012-08-06 20:05:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable hosts done >2012-08-06 20:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable storage domains >2012-08-06 20:05:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Autorecovering 1 storage domains >2012-08-06 20:05:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 20:05:00,033 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-24) [66bc13b7] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:05:00,083 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-24) [66bc13b7] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 20:05:00,117 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-24) [66bc13b7] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:05:00,118 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-24) [66bc13b7] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 8:05 PM >2012-08-06 20:05:00,144 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [66bc13b7] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 3194003f >2012-08-06 20:08:00,149 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [66bc13b7] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 20:08:00,150 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [66bc13b7] FINISH, ConnectStorageServerVDSCommand, log id: 3194003f >2012-08-06 20:08:00,151 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [66bc13b7] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 20:08:00,184 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-24) [66bc13b7] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 8:08 PM >2012-08-06 20:08:00,185 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-24) [66bc13b7] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 204a6adf >2012-08-06 20:08:00,449 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-24) [66bc13b7] Failed in ActivateStorageDomainVDS method >2012-08-06 20:08:00,450 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-24) [66bc13b7] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:08:00,453 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) [66bc13b7] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:08:00,460 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-24) [66bc13b7] FINISH, ActivateStorageDomainVDSCommand, log id: 204a6adf >2012-08-06 20:08:00,463 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-24) [66bc13b7] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:08:00,474 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-24) [66bc13b7] Command [id=33a213df-bc33-4275-bf52-e5d303cd243d]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 20:08:00,503 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) [66bc13b7] Checking autorecoverable storage domains done >2012-08-06 20:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) Checking autorecoverable hosts >2012-08-06 20:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) Autorecovering 0 hosts >2012-08-06 20:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) Checking autorecoverable hosts done >2012-08-06 20:10:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) Checking autorecoverable storage domains >2012-08-06 20:10:00,045 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) Autorecovering 1 storage domains >2012-08-06 20:10:00,047 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 20:10:00,052 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [66d8b960] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:10:00,121 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [66d8b960] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 20:10:00,171 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [66d8b960] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:10:00,172 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [66d8b960] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 8:10 PM >2012-08-06 20:10:00,187 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [66d8b960] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 2bced06e >2012-08-06 20:13:00,195 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [66d8b960] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 20:13:00,196 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [66d8b960] FINISH, ConnectStorageServerVDSCommand, log id: 2bced06e >2012-08-06 20:13:00,202 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [66d8b960] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 20:13:00,252 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [66d8b960] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 8:13 PM >2012-08-06 20:13:00,254 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-81) [66d8b960] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 42471d1d >2012-08-06 20:13:00,517 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-81) [66d8b960] Failed in ActivateStorageDomainVDS method >2012-08-06 20:13:00,517 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-81) [66d8b960] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:13:00,519 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-81) [66d8b960] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:13:00,524 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-81) [66d8b960] FINISH, ActivateStorageDomainVDSCommand, log id: 42471d1d >2012-08-06 20:13:00,528 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [66d8b960] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:13:00,541 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [66d8b960] Command [id=596bd8ba-611e-47df-b7d2-1975a9ec866a]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 20:13:00,565 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [66d8b960] Checking autorecoverable storage domains done >2012-08-06 20:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [243a5a65] Checking autorecoverable hosts >2012-08-06 20:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [243a5a65] Autorecovering 0 hosts >2012-08-06 20:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [243a5a65] Checking autorecoverable hosts done >2012-08-06 20:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [243a5a65] Checking autorecoverable storage domains >2012-08-06 20:15:00,036 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [243a5a65] Autorecovering 1 storage domains >2012-08-06 20:15:00,041 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [243a5a65] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 20:15:00,046 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [45d039b2] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:15:00,103 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [45d039b2] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 20:15:00,120 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [45d039b2] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:15:00,124 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [45d039b2] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 8:15 PM >2012-08-06 20:15:00,144 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [45d039b2] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 39c644ae >2012-08-06 20:18:00,154 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [45d039b2] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 20:18:00,156 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [45d039b2] FINISH, ConnectStorageServerVDSCommand, log id: 39c644ae >2012-08-06 20:18:00,161 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [45d039b2] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 20:18:00,213 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [45d039b2] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 8:18 PM >2012-08-06 20:18:00,215 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-37) [45d039b2] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 4f32185e >2012-08-06 20:18:00,479 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-37) [45d039b2] Failed in ActivateStorageDomainVDS method >2012-08-06 20:18:00,480 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-37) [45d039b2] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:18:00,482 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-37) [45d039b2] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:18:00,490 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-37) [45d039b2] FINISH, ActivateStorageDomainVDSCommand, log id: 4f32185e >2012-08-06 20:18:00,496 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [45d039b2] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:18:00,516 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [45d039b2] Command [id=51244ebb-1fc4-4f04-9f55-fd3b23293526]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 20:18:00,575 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [45d039b2] Checking autorecoverable storage domains done >2012-08-06 20:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) [6a0b4f90] Checking autorecoverable hosts >2012-08-06 20:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) [6a0b4f90] Autorecovering 0 hosts >2012-08-06 20:20:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) [6a0b4f90] Checking autorecoverable hosts done >2012-08-06 20:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) [6a0b4f90] Checking autorecoverable storage domains >2012-08-06 20:20:00,048 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) [6a0b4f90] Autorecovering 1 storage domains >2012-08-06 20:20:00,051 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) [6a0b4f90] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 20:20:00,069 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-18) [452f996d] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:20:00,106 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-18) [452f996d] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 20:20:00,130 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-18) [452f996d] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:20:00,135 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-18) [452f996d] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 8:20 PM >2012-08-06 20:20:00,170 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [452f996d] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 7740fffe >2012-08-06 20:23:00,174 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [452f996d] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 20:23:00,175 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [452f996d] FINISH, ConnectStorageServerVDSCommand, log id: 7740fffe >2012-08-06 20:23:00,177 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [452f996d] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 20:23:00,211 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-18) [452f996d] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 8:23 PM >2012-08-06 20:23:00,213 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-18) [452f996d] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 1d5eafc0 >2012-08-06 20:23:00,468 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-18) [452f996d] Failed in ActivateStorageDomainVDS method >2012-08-06 20:23:00,469 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-18) [452f996d] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:23:00,470 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-18) [452f996d] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:23:00,478 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-18) [452f996d] FINISH, ActivateStorageDomainVDSCommand, log id: 1d5eafc0 >2012-08-06 20:23:00,481 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-18) [452f996d] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:23:00,493 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-18) [452f996d] Command [id=55e6ffa7-7aed-4644-aaea-4c226e9dadcd]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 20:23:00,522 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) [452f996d] Checking autorecoverable storage domains done >2012-08-06 20:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) [2b5eace3] Checking autorecoverable hosts >2012-08-06 20:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) [2b5eace3] Autorecovering 0 hosts >2012-08-06 20:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) [2b5eace3] Checking autorecoverable hosts done >2012-08-06 20:25:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) [2b5eace3] Checking autorecoverable storage domains >2012-08-06 20:25:00,040 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) [2b5eace3] Autorecovering 1 storage domains >2012-08-06 20:25:00,043 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) [2b5eace3] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 20:25:00,048 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-47) [31568f3b] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:25:00,083 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-47) [31568f3b] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 20:25:00,108 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-47) [31568f3b] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:25:00,112 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-47) [31568f3b] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 8:25 PM >2012-08-06 20:25:00,129 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [31568f3b] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 25b7ab33 >2012-08-06 20:28:00,133 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [31568f3b] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 20:28:00,134 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [31568f3b] FINISH, ConnectStorageServerVDSCommand, log id: 25b7ab33 >2012-08-06 20:28:00,135 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [31568f3b] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 20:28:00,187 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-47) [31568f3b] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 8:28 PM >2012-08-06 20:28:00,190 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-47) [31568f3b] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 4a8fb8d4 >2012-08-06 20:28:00,455 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-47) [31568f3b] Failed in ActivateStorageDomainVDS method >2012-08-06 20:28:00,456 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-47) [31568f3b] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:28:00,460 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) [31568f3b] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:28:00,468 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-47) [31568f3b] FINISH, ActivateStorageDomainVDSCommand, log id: 4a8fb8d4 >2012-08-06 20:28:00,471 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-47) [31568f3b] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:28:00,488 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-47) [31568f3b] Command [id=5335925c-b732-4a0e-947d-60ee0672a631]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 20:28:00,541 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) [31568f3b] Checking autorecoverable storage domains done >2012-08-06 20:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Checking autorecoverable hosts >2012-08-06 20:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Autorecovering 0 hosts >2012-08-06 20:30:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Checking autorecoverable hosts done >2012-08-06 20:30:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Checking autorecoverable storage domains >2012-08-06 20:30:00,035 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Autorecovering 1 storage domains >2012-08-06 20:30:00,037 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 20:30:00,042 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [325397e3] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:30:00,093 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [325397e3] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 20:30:00,115 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [325397e3] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:30:00,120 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [325397e3] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 8:30 PM >2012-08-06 20:30:00,138 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [325397e3] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: c665b47 >2012-08-06 20:33:00,145 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [325397e3] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 20:33:00,146 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [325397e3] FINISH, ConnectStorageServerVDSCommand, log id: c665b47 >2012-08-06 20:33:00,146 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [325397e3] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 20:33:00,177 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [325397e3] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 8:33 PM >2012-08-06 20:33:00,178 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-33) [325397e3] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 41ee0f94 >2012-08-06 20:33:00,431 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-33) [325397e3] Failed in ActivateStorageDomainVDS method >2012-08-06 20:33:00,432 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-33) [325397e3] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:33:00,434 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-33) [325397e3] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:33:00,447 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-33) [325397e3] FINISH, ActivateStorageDomainVDSCommand, log id: 41ee0f94 >2012-08-06 20:33:00,457 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [325397e3] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:33:00,480 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [325397e3] Command [id=9914025b-662f-4f90-a4a1-cbd75121dd6c]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 20:33:00,516 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) [325397e3] Checking autorecoverable storage domains done >2012-08-06 20:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [66d8b960] Checking autorecoverable hosts >2012-08-06 20:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [66d8b960] Autorecovering 0 hosts >2012-08-06 20:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [66d8b960] Checking autorecoverable hosts done >2012-08-06 20:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [66d8b960] Checking autorecoverable storage domains >2012-08-06 20:35:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [66d8b960] Autorecovering 1 storage domains >2012-08-06 20:35:00,029 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [66d8b960] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 20:35:00,033 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [f4c416e] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:35:00,081 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [f4c416e] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 20:35:00,105 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [f4c416e] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:35:00,113 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [f4c416e] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 8:35 PM >2012-08-06 20:35:00,130 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [f4c416e] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 509bae2f >2012-08-06 20:38:00,135 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [f4c416e] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 20:38:00,139 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [f4c416e] FINISH, ConnectStorageServerVDSCommand, log id: 509bae2f >2012-08-06 20:38:00,142 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [f4c416e] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 20:38:00,188 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [f4c416e] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 8:38 PM >2012-08-06 20:38:00,189 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-81) [f4c416e] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 4cea044e >2012-08-06 20:38:00,450 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-81) [f4c416e] Failed in ActivateStorageDomainVDS method >2012-08-06 20:38:00,451 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-81) [f4c416e] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:38:00,452 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-81) [f4c416e] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:38:00,462 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-81) [f4c416e] FINISH, ActivateStorageDomainVDSCommand, log id: 4cea044e >2012-08-06 20:38:00,466 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [f4c416e] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:38:00,479 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [f4c416e] Command [id=d3010ccc-fabe-4163-baa8-6c0225072941]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 20:38:00,513 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [f4c416e] Checking autorecoverable storage domains done >2012-08-06 20:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) Checking autorecoverable hosts >2012-08-06 20:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) Autorecovering 0 hosts >2012-08-06 20:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) Checking autorecoverable hosts done >2012-08-06 20:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) Checking autorecoverable storage domains >2012-08-06 20:40:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) Autorecovering 1 storage domains >2012-08-06 20:40:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 20:40:00,030 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-97) [52b07041] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:40:00,086 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-97) [52b07041] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 20:40:00,111 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-97) [52b07041] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:40:00,116 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-97) [52b07041] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 8:40 PM >2012-08-06 20:40:00,132 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [52b07041] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 357f199d >2012-08-06 20:43:00,135 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [52b07041] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 20:43:00,136 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [52b07041] FINISH, ConnectStorageServerVDSCommand, log id: 357f199d >2012-08-06 20:43:00,139 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [52b07041] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 20:43:00,179 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-97) [52b07041] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 8:43 PM >2012-08-06 20:43:00,180 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-97) [52b07041] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 3ac1370d >2012-08-06 20:43:00,442 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-97) [52b07041] Failed in ActivateStorageDomainVDS method >2012-08-06 20:43:00,442 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-97) [52b07041] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:43:00,444 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) [52b07041] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:43:00,449 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-97) [52b07041] FINISH, ActivateStorageDomainVDSCommand, log id: 3ac1370d >2012-08-06 20:43:00,453 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-97) [52b07041] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:43:00,467 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-97) [52b07041] Command [id=3da95383-d969-46c4-b049-600afeccc1f6]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 20:43:00,488 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) [52b07041] Checking autorecoverable storage domains done >2012-08-06 20:43:07,305 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-18) [452f996d] DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 20:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) Checking autorecoverable hosts >2012-08-06 20:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) Autorecovering 0 hosts >2012-08-06 20:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) Checking autorecoverable hosts done >2012-08-06 20:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) Checking autorecoverable storage domains >2012-08-06 20:45:00,022 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) Autorecovering 1 storage domains >2012-08-06 20:45:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 20:45:00,029 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-14) [1861770c] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:45:00,074 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-14) [1861770c] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 20:45:00,098 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-14) [1861770c] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:45:00,102 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-14) [1861770c] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 8:45 PM >2012-08-06 20:45:00,119 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [1861770c] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 52e946b7 >2012-08-06 20:48:00,122 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [1861770c] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 20:48:00,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [1861770c] FINISH, ConnectStorageServerVDSCommand, log id: 52e946b7 >2012-08-06 20:48:00,124 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [1861770c] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 20:48:00,155 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-14) [1861770c] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 8:48 PM >2012-08-06 20:48:00,155 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-14) [1861770c] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 66248b8d >2012-08-06 20:48:00,416 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-14) [1861770c] Failed in ActivateStorageDomainVDS method >2012-08-06 20:48:00,416 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-14) [1861770c] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:48:00,418 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-14) [1861770c] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:48:00,427 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-14) [1861770c] FINISH, ActivateStorageDomainVDSCommand, log id: 66248b8d >2012-08-06 20:48:00,431 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-14) [1861770c] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:48:00,444 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-14) [1861770c] Command [id=565d4991-b9f5-4b3b-804a-3e600cbe2899]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 20:48:00,465 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) [1861770c] Checking autorecoverable storage domains done >2012-08-06 20:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Checking autorecoverable hosts >2012-08-06 20:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Autorecovering 0 hosts >2012-08-06 20:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Checking autorecoverable hosts done >2012-08-06 20:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Checking autorecoverable storage domains >2012-08-06 20:50:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Autorecovering 1 storage domains >2012-08-06 20:50:00,025 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 20:50:00,030 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-45) [2749f438] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:50:00,077 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-45) [2749f438] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 20:50:00,096 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-45) [2749f438] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:50:00,101 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-45) [2749f438] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 8:50 PM >2012-08-06 20:50:00,118 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [2749f438] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 25abb539 >2012-08-06 20:53:00,123 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [2749f438] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 20:53:00,124 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [2749f438] FINISH, ConnectStorageServerVDSCommand, log id: 25abb539 >2012-08-06 20:53:00,126 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [2749f438] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 20:53:00,163 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-45) [2749f438] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 8:53 PM >2012-08-06 20:53:00,164 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-45) [2749f438] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 594d0dc1 >2012-08-06 20:53:00,422 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-45) [2749f438] Failed in ActivateStorageDomainVDS method >2012-08-06 20:53:00,423 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-45) [2749f438] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:53:00,425 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) [2749f438] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:53:00,432 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-45) [2749f438] FINISH, ActivateStorageDomainVDSCommand, log id: 594d0dc1 >2012-08-06 20:53:00,436 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-45) [2749f438] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:53:00,448 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-45) [2749f438] Command [id=ee05ddbd-f9ed-49f0-9448-5f8658ecbae9]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 20:53:00,484 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) [2749f438] Checking autorecoverable storage domains done >2012-08-06 20:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable hosts >2012-08-06 20:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Autorecovering 0 hosts >2012-08-06 20:55:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable hosts done >2012-08-06 20:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Checking autorecoverable storage domains >2012-08-06 20:55:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Autorecovering 1 storage domains >2012-08-06 20:55:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 20:55:00,031 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-38) [4670e2e6] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:55:00,070 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-38) [4670e2e6] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 20:55:00,088 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-38) [4670e2e6] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 20:55:00,093 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-38) [4670e2e6] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 8:55 PM >2012-08-06 20:55:00,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [4670e2e6] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 5e1813a5 >2012-08-06 20:58:00,113 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [4670e2e6] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 20:58:00,114 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [4670e2e6] FINISH, ConnectStorageServerVDSCommand, log id: 5e1813a5 >2012-08-06 20:58:00,118 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [4670e2e6] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 20:58:00,154 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-38) [4670e2e6] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 8:58 PM >2012-08-06 20:58:00,155 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-38) [4670e2e6] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 19494778 >2012-08-06 20:58:00,411 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-38) [4670e2e6] Failed in ActivateStorageDomainVDS method >2012-08-06 20:58:00,412 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-38) [4670e2e6] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:58:00,414 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-38) [4670e2e6] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:58:00,422 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-38) [4670e2e6] FINISH, ActivateStorageDomainVDSCommand, log id: 19494778 >2012-08-06 20:58:00,425 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-38) [4670e2e6] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 20:58:00,446 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-38) [4670e2e6] Command [id=bce1b2a1-5589-40b0-be19-7e28ec32949b]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 20:58:00,481 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-38) [4670e2e6] Checking autorecoverable storage domains done >2012-08-06 21:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable hosts >2012-08-06 21:00:00,039 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Autorecovering 0 hosts >2012-08-06 21:00:00,039 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable hosts done >2012-08-06 21:00:00,040 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable storage domains >2012-08-06 21:00:00,058 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Autorecovering 1 storage domains >2012-08-06 21:00:00,061 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 21:00:00,071 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [104723cd] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:00:00,114 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [104723cd] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 21:00:00,139 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [104723cd] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:00:00,144 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [104723cd] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 9:00 PM >2012-08-06 21:00:00,160 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [104723cd] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 7218c24e >2012-08-06 21:03:00,164 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [104723cd] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 21:03:00,165 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [104723cd] FINISH, ConnectStorageServerVDSCommand, log id: 7218c24e >2012-08-06 21:03:00,165 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [104723cd] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 21:03:00,216 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [104723cd] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 9:03 PM >2012-08-06 21:03:00,217 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-58) [104723cd] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 4310dfd5 >2012-08-06 21:03:00,480 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-58) [104723cd] Failed in ActivateStorageDomainVDS method >2012-08-06 21:03:00,481 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-58) [104723cd] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:03:00,482 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-58) [104723cd] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:03:00,506 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-58) [104723cd] FINISH, ActivateStorageDomainVDSCommand, log id: 4310dfd5 >2012-08-06 21:03:00,509 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [104723cd] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:03:00,523 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [104723cd] Command [id=f38494f3-384a-4ab3-9591-fbd831ffe495]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 21:03:00,582 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) [104723cd] Checking autorecoverable storage domains done >2012-08-06 21:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Checking autorecoverable hosts >2012-08-06 21:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Autorecovering 0 hosts >2012-08-06 21:05:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Checking autorecoverable hosts done >2012-08-06 21:05:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Checking autorecoverable storage domains >2012-08-06 21:05:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Autorecovering 1 storage domains >2012-08-06 21:05:00,029 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 21:05:00,034 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-80) [7c6a70be] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:05:00,111 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-80) [7c6a70be] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 21:05:00,139 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-80) [7c6a70be] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:05:00,143 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-80) [7c6a70be] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 9:05 PM >2012-08-06 21:05:00,160 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [7c6a70be] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 4a0215c1 >2012-08-06 21:08:00,168 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [7c6a70be] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 21:08:00,169 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [7c6a70be] FINISH, ConnectStorageServerVDSCommand, log id: 4a0215c1 >2012-08-06 21:08:00,170 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [7c6a70be] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 21:08:00,200 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-80) [7c6a70be] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 9:08 PM >2012-08-06 21:08:00,201 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-80) [7c6a70be] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 540ffecc >2012-08-06 21:08:00,452 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-80) [7c6a70be] Failed in ActivateStorageDomainVDS method >2012-08-06 21:08:00,453 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-80) [7c6a70be] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:08:00,454 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-80) [7c6a70be] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:08:00,456 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-80) [7c6a70be] FINISH, ActivateStorageDomainVDSCommand, log id: 540ffecc >2012-08-06 21:08:00,460 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-80) [7c6a70be] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:08:00,479 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-80) [7c6a70be] Command [id=c875a213-d469-4d71-a426-0d2934e1f893]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 21:08:00,522 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) [7c6a70be] Checking autorecoverable storage domains done >2012-08-06 21:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable hosts >2012-08-06 21:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Autorecovering 0 hosts >2012-08-06 21:10:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable hosts done >2012-08-06 21:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable storage domains >2012-08-06 21:10:00,061 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Autorecovering 1 storage domains >2012-08-06 21:10:00,067 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 21:10:00,073 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [3361e47d] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:10:00,169 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [3361e47d] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 21:10:00,233 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [3361e47d] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:10:00,235 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [3361e47d] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 9:10 PM >2012-08-06 21:10:00,251 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [3361e47d] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 4da7008f >2012-08-06 21:13:00,258 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [3361e47d] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 21:13:00,259 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [3361e47d] FINISH, ConnectStorageServerVDSCommand, log id: 4da7008f >2012-08-06 21:13:00,261 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [3361e47d] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 21:13:00,318 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [3361e47d] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 9:13 PM >2012-08-06 21:13:00,319 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-96) [3361e47d] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 20d33187 >2012-08-06 21:13:00,572 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-96) [3361e47d] Failed in ActivateStorageDomainVDS method >2012-08-06 21:13:00,573 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-96) [3361e47d] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:13:00,576 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) [3361e47d] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:13:00,584 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-96) [3361e47d] FINISH, ActivateStorageDomainVDSCommand, log id: 20d33187 >2012-08-06 21:13:00,587 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [3361e47d] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:13:00,605 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [3361e47d] Command [id=55644b32-6e78-458e-936e-00c5f0d676de]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 21:13:00,647 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) [3361e47d] Checking autorecoverable storage domains done >2012-08-06 21:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [597ec698] Checking autorecoverable hosts >2012-08-06 21:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [597ec698] Autorecovering 0 hosts >2012-08-06 21:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [597ec698] Checking autorecoverable hosts done >2012-08-06 21:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [597ec698] Checking autorecoverable storage domains >2012-08-06 21:15:00,034 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [597ec698] Autorecovering 1 storage domains >2012-08-06 21:15:00,036 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [597ec698] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 21:15:00,040 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-5) [7d34aeac] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:15:00,074 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-5) [7d34aeac] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 21:15:00,102 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-5) [7d34aeac] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:15:00,106 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-5) [7d34aeac] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 9:15 PM >2012-08-06 21:15:00,122 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [7d34aeac] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 500986ea >2012-08-06 21:18:00,125 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [7d34aeac] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 21:18:00,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [7d34aeac] FINISH, ConnectStorageServerVDSCommand, log id: 500986ea >2012-08-06 21:18:00,127 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [7d34aeac] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 21:18:00,159 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-5) [7d34aeac] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 9:18 PM >2012-08-06 21:18:00,160 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-5) [7d34aeac] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 6bb40dc0 >2012-08-06 21:18:00,414 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-5) [7d34aeac] Failed in ActivateStorageDomainVDS method >2012-08-06 21:18:00,415 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-5) [7d34aeac] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:18:00,422 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-5) [7d34aeac] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:18:00,430 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-5) [7d34aeac] FINISH, ActivateStorageDomainVDSCommand, log id: 6bb40dc0 >2012-08-06 21:18:00,434 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-5) [7d34aeac] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:18:00,455 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-5) [7d34aeac] Command [id=1f58a52d-3632-4b5f-bd30-16520b921eab]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 21:18:00,495 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [7d34aeac] Checking autorecoverable storage domains done >2012-08-06 21:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) [764ba3c5] Checking autorecoverable hosts >2012-08-06 21:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) [764ba3c5] Autorecovering 0 hosts >2012-08-06 21:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) [764ba3c5] Checking autorecoverable hosts done >2012-08-06 21:20:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) [764ba3c5] Checking autorecoverable storage domains >2012-08-06 21:20:00,038 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) [764ba3c5] Autorecovering 1 storage domains >2012-08-06 21:20:00,038 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) [764ba3c5] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 21:20:00,040 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [4b26dace] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:20:00,102 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [4b26dace] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 21:20:00,171 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [4b26dace] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:20:00,172 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [4b26dace] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 9:20 PM >2012-08-06 21:20:00,189 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [4b26dace] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 35ce2f56 >2012-08-06 21:23:00,197 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [4b26dace] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 21:23:00,198 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [4b26dace] FINISH, ConnectStorageServerVDSCommand, log id: 35ce2f56 >2012-08-06 21:23:00,199 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [4b26dace] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 21:23:00,229 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [4b26dace] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 9:23 PM >2012-08-06 21:23:00,230 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-23) [4b26dace] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 133caee2 >2012-08-06 21:23:00,493 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-23) [4b26dace] Failed in ActivateStorageDomainVDS method >2012-08-06 21:23:00,494 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-23) [4b26dace] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:23:00,495 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) [4b26dace] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:23:00,501 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-23) [4b26dace] FINISH, ActivateStorageDomainVDSCommand, log id: 133caee2 >2012-08-06 21:23:00,505 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [4b26dace] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:23:00,516 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [4b26dace] Command [id=ba6a99fa-31dc-4b5e-96d8-2912373da848]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 21:23:00,539 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) [4b26dace] Checking autorecoverable storage domains done >2012-08-06 21:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [f4c416e] Checking autorecoverable hosts >2012-08-06 21:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [f4c416e] Autorecovering 0 hosts >2012-08-06 21:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [f4c416e] Checking autorecoverable hosts done >2012-08-06 21:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [f4c416e] Checking autorecoverable storage domains >2012-08-06 21:25:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [f4c416e] Autorecovering 1 storage domains >2012-08-06 21:25:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [f4c416e] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 21:25:00,033 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [6b6e53e0] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:25:00,081 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [6b6e53e0] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 21:25:00,107 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [6b6e53e0] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:25:00,117 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [6b6e53e0] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 9:25 PM >2012-08-06 21:25:00,134 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [6b6e53e0] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 7723c876 >2012-08-06 21:28:00,137 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [6b6e53e0] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 21:28:00,138 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [6b6e53e0] FINISH, ConnectStorageServerVDSCommand, log id: 7723c876 >2012-08-06 21:28:00,139 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [6b6e53e0] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 21:28:00,173 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [6b6e53e0] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 9:28 PM >2012-08-06 21:28:00,177 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-81) [6b6e53e0] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 28ce1bfc >2012-08-06 21:28:00,444 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-81) [6b6e53e0] Failed in ActivateStorageDomainVDS method >2012-08-06 21:28:00,445 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-81) [6b6e53e0] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:28:00,446 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-81) [6b6e53e0] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:28:00,449 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-81) [6b6e53e0] FINISH, ActivateStorageDomainVDSCommand, log id: 28ce1bfc >2012-08-06 21:28:00,453 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [6b6e53e0] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:28:00,464 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [6b6e53e0] Command [id=caf4d308-31fa-47e8-a519-eecb665f2930]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 21:28:00,486 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [6b6e53e0] Checking autorecoverable storage domains done >2012-08-06 21:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Checking autorecoverable hosts >2012-08-06 21:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Autorecovering 0 hosts >2012-08-06 21:30:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Checking autorecoverable hosts done >2012-08-06 21:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Checking autorecoverable storage domains >2012-08-06 21:30:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Autorecovering 1 storage domains >2012-08-06 21:30:00,032 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 21:30:00,037 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [2e7f0361] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:30:00,072 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [2e7f0361] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 21:30:00,092 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [2e7f0361] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:30:00,096 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [2e7f0361] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 9:30 PM >2012-08-06 21:30:00,113 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [2e7f0361] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 13b79d88 >2012-08-06 21:33:00,117 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [2e7f0361] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 21:33:00,118 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [2e7f0361] FINISH, ConnectStorageServerVDSCommand, log id: 13b79d88 >2012-08-06 21:33:00,118 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [2e7f0361] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 21:33:00,150 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [2e7f0361] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 9:33 PM >2012-08-06 21:33:00,151 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-35) [2e7f0361] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 6f689f3d >2012-08-06 21:33:00,402 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-35) [2e7f0361] Failed in ActivateStorageDomainVDS method >2012-08-06 21:33:00,403 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-35) [2e7f0361] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:33:00,404 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-35) [2e7f0361] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:33:00,410 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-35) [2e7f0361] FINISH, ActivateStorageDomainVDSCommand, log id: 6f689f3d >2012-08-06 21:33:00,413 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [2e7f0361] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:33:00,428 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [2e7f0361] Command [id=611b90d7-f955-436f-b9b9-476a3dc88968]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 21:33:00,457 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [2e7f0361] Checking autorecoverable storage domains done >2012-08-06 21:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) [391f73ae] Checking autorecoverable hosts >2012-08-06 21:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) [391f73ae] Autorecovering 0 hosts >2012-08-06 21:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) [391f73ae] Checking autorecoverable hosts done >2012-08-06 21:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) [391f73ae] Checking autorecoverable storage domains >2012-08-06 21:35:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) [391f73ae] Autorecovering 1 storage domains >2012-08-06 21:35:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) [391f73ae] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 21:35:00,030 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-25) [4e21c054] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:35:00,072 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-25) [4e21c054] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 21:35:00,088 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-25) [4e21c054] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:35:00,093 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-25) [4e21c054] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 9:35 PM >2012-08-06 21:35:00,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [4e21c054] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: e24889e >2012-08-06 21:38:00,115 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [4e21c054] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 21:38:00,116 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [4e21c054] FINISH, ConnectStorageServerVDSCommand, log id: e24889e >2012-08-06 21:38:00,117 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [4e21c054] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 21:38:00,146 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-25) [4e21c054] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 9:38 PM >2012-08-06 21:38:00,147 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-25) [4e21c054] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 1782eec5 >2012-08-06 21:38:00,462 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-25) [4e21c054] Failed in ActivateStorageDomainVDS method >2012-08-06 21:38:00,462 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-25) [4e21c054] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:38:00,464 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-25) [4e21c054] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:38:00,471 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-25) [4e21c054] FINISH, ActivateStorageDomainVDSCommand, log id: 1782eec5 >2012-08-06 21:38:00,474 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-25) [4e21c054] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:38:00,488 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-25) [4e21c054] Command [id=5b4aa3e3-9ba8-482c-9f82-e08cdf28a914]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 21:38:00,533 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) [4e21c054] Checking autorecoverable storage domains done >2012-08-06 21:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Checking autorecoverable hosts >2012-08-06 21:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Autorecovering 0 hosts >2012-08-06 21:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Checking autorecoverable hosts done >2012-08-06 21:40:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Checking autorecoverable storage domains >2012-08-06 21:40:00,063 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Autorecovering 1 storage domains >2012-08-06 21:40:00,064 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 21:40:00,067 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [6bb17d09] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:40:00,107 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [6bb17d09] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 21:40:00,135 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [6bb17d09] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:40:00,136 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [6bb17d09] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 9:40 PM >2012-08-06 21:40:00,150 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [6bb17d09] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 32da6364 >2012-08-06 21:43:00,155 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [6bb17d09] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 21:43:00,156 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [6bb17d09] FINISH, ConnectStorageServerVDSCommand, log id: 32da6364 >2012-08-06 21:43:00,161 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [6bb17d09] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 21:43:00,204 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [6bb17d09] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 9:43 PM >2012-08-06 21:43:00,205 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-69) [6bb17d09] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 4f322963 >2012-08-06 21:43:00,457 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-69) [6bb17d09] Failed in ActivateStorageDomainVDS method >2012-08-06 21:43:00,457 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-69) [6bb17d09] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:43:00,459 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) [6bb17d09] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:43:00,464 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-69) [6bb17d09] FINISH, ActivateStorageDomainVDSCommand, log id: 4f322963 >2012-08-06 21:43:00,467 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [6bb17d09] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:43:00,482 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [6bb17d09] Command [id=a85a87a4-1beb-429a-978d-4e2430c9c8c2]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 21:43:00,514 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [6bb17d09] Checking autorecoverable storage domains done >2012-08-06 21:43:07,310 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-8) DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 21:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable hosts >2012-08-06 21:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Autorecovering 0 hosts >2012-08-06 21:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable hosts done >2012-08-06 21:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable storage domains >2012-08-06 21:45:00,025 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Autorecovering 1 storage domains >2012-08-06 21:45:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 21:45:00,037 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-8) [174972f6] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:45:00,097 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-8) [174972f6] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 21:45:00,120 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-8) [174972f6] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:45:00,125 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-8) [174972f6] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 9:45 PM >2012-08-06 21:45:00,152 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [174972f6] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 589158d3 >2012-08-06 21:48:00,156 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [174972f6] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 21:48:00,157 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [174972f6] FINISH, ConnectStorageServerVDSCommand, log id: 589158d3 >2012-08-06 21:48:00,159 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [174972f6] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 21:48:00,190 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-8) [174972f6] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 9:48 PM >2012-08-06 21:48:00,191 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-8) [174972f6] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: c4918e8 >2012-08-06 21:48:00,443 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-8) [174972f6] Failed in ActivateStorageDomainVDS method >2012-08-06 21:48:00,444 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-8) [174972f6] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:48:00,445 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) [174972f6] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:48:00,451 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-8) [174972f6] FINISH, ActivateStorageDomainVDSCommand, log id: c4918e8 >2012-08-06 21:48:00,455 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-8) [174972f6] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:48:00,470 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-8) [174972f6] Command [id=6147662f-33d3-4a96-b533-aae01a5b39ce]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 21:48:00,495 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) [174972f6] Checking autorecoverable storage domains done >2012-08-06 21:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [406cbd81] Checking autorecoverable hosts >2012-08-06 21:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [406cbd81] Autorecovering 0 hosts >2012-08-06 21:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [406cbd81] Checking autorecoverable hosts done >2012-08-06 21:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [406cbd81] Checking autorecoverable storage domains >2012-08-06 21:50:00,029 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [406cbd81] Autorecovering 1 storage domains >2012-08-06 21:50:00,031 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [406cbd81] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 21:50:00,038 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [134b55bd] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:50:00,078 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [134b55bd] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 21:50:00,099 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [134b55bd] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:50:00,104 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [134b55bd] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 9:50 PM >2012-08-06 21:50:00,121 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [134b55bd] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 217e8806 >2012-08-06 21:53:00,130 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [134b55bd] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 21:53:00,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [134b55bd] FINISH, ConnectStorageServerVDSCommand, log id: 217e8806 >2012-08-06 21:53:00,132 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [134b55bd] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 21:53:00,164 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [134b55bd] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 9:53 PM >2012-08-06 21:53:00,165 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-93) [134b55bd] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: f25a233 >2012-08-06 21:53:00,420 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-93) [134b55bd] Failed in ActivateStorageDomainVDS method >2012-08-06 21:53:00,420 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-93) [134b55bd] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:53:00,422 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) [134b55bd] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:53:00,427 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-93) [134b55bd] FINISH, ActivateStorageDomainVDSCommand, log id: f25a233 >2012-08-06 21:53:00,430 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [134b55bd] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:53:00,446 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [134b55bd] Command [id=cf3a7b82-a74c-48ff-8624-4047443e4589]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 21:53:00,471 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [134b55bd] Checking autorecoverable storage domains done >2012-08-06 21:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) Checking autorecoverable hosts >2012-08-06 21:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) Autorecovering 0 hosts >2012-08-06 21:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) Checking autorecoverable hosts done >2012-08-06 21:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) Checking autorecoverable storage domains >2012-08-06 21:55:00,055 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) Autorecovering 1 storage domains >2012-08-06 21:55:00,058 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 21:55:00,062 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-84) [75019685] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:55:00,131 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-84) [75019685] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 21:55:00,161 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-84) [75019685] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 21:55:00,162 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-84) [75019685] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 9:55 PM >2012-08-06 21:55:00,175 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [75019685] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 22f18911 >2012-08-06 21:58:00,179 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [75019685] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 21:58:00,180 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [75019685] FINISH, ConnectStorageServerVDSCommand, log id: 22f18911 >2012-08-06 21:58:00,181 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [75019685] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 21:58:00,212 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-84) [75019685] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 9:58 PM >2012-08-06 21:58:00,213 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-84) [75019685] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 66ff737e >2012-08-06 21:58:00,484 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-84) [75019685] Failed in ActivateStorageDomainVDS method >2012-08-06 21:58:00,485 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-84) [75019685] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:58:00,486 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) [75019685] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:58:00,501 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-84) [75019685] FINISH, ActivateStorageDomainVDSCommand, log id: 66ff737e >2012-08-06 21:58:00,510 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-84) [75019685] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 21:58:00,533 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-84) [75019685] Command [id=7dda7d21-a757-4a60-87b5-fafce2fabbc7]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 21:58:00,571 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) [75019685] Checking autorecoverable storage domains done >2012-08-06 22:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable hosts >2012-08-06 22:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Autorecovering 0 hosts >2012-08-06 22:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable hosts done >2012-08-06 22:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Checking autorecoverable storage domains >2012-08-06 22:00:00,083 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Autorecovering 1 storage domains >2012-08-06 22:00:00,085 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 22:00:00,090 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [7ab9c51e] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:00:00,142 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [7ab9c51e] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 22:00:00,168 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [7ab9c51e] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:00:00,169 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [7ab9c51e] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 10:00 PM >2012-08-06 22:00:00,183 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [7ab9c51e] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 6ed1e282 >2012-08-06 22:03:00,187 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [7ab9c51e] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 22:03:00,188 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [7ab9c51e] FINISH, ConnectStorageServerVDSCommand, log id: 6ed1e282 >2012-08-06 22:03:00,188 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [7ab9c51e] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 22:03:00,216 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [7ab9c51e] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 10:03 PM >2012-08-06 22:03:00,217 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-30) [7ab9c51e] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 61c00b49 >2012-08-06 22:03:00,489 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-30) [7ab9c51e] Failed in ActivateStorageDomainVDS method >2012-08-06 22:03:00,490 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-30) [7ab9c51e] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:03:00,494 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-30) [7ab9c51e] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:03:00,499 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-30) [7ab9c51e] FINISH, ActivateStorageDomainVDSCommand, log id: 61c00b49 >2012-08-06 22:03:00,503 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [7ab9c51e] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:03:00,519 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [7ab9c51e] Command [id=804ad27c-d055-4dec-912e-177361e88a2c]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 22:03:00,533 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) [7ab9c51e] Checking autorecoverable storage domains done >2012-08-06 22:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) [54670533] Checking autorecoverable hosts >2012-08-06 22:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) [54670533] Autorecovering 0 hosts >2012-08-06 22:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) [54670533] Checking autorecoverable hosts done >2012-08-06 22:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) [54670533] Checking autorecoverable storage domains >2012-08-06 22:05:00,029 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) [54670533] Autorecovering 1 storage domains >2012-08-06 22:05:00,032 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) [54670533] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 22:05:00,036 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-60) [2a2ffad5] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:05:00,126 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-60) [2a2ffad5] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 22:05:00,160 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-60) [2a2ffad5] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:05:00,164 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-60) [2a2ffad5] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 10:05 PM >2012-08-06 22:05:00,181 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [2a2ffad5] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 1bbb8396 >2012-08-06 22:08:00,185 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [2a2ffad5] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 22:08:00,187 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [2a2ffad5] FINISH, ConnectStorageServerVDSCommand, log id: 1bbb8396 >2012-08-06 22:08:00,188 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [2a2ffad5] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 22:08:00,217 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-60) [2a2ffad5] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 10:08 PM >2012-08-06 22:08:00,218 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-60) [2a2ffad5] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 95e6b45 >2012-08-06 22:08:00,527 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-60) [2a2ffad5] Failed in ActivateStorageDomainVDS method >2012-08-06 22:08:00,527 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-60) [2a2ffad5] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:08:00,530 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-60) [2a2ffad5] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:08:00,538 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-60) [2a2ffad5] FINISH, ActivateStorageDomainVDSCommand, log id: 95e6b45 >2012-08-06 22:08:00,541 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-60) [2a2ffad5] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:08:00,552 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-60) [2a2ffad5] Command [id=8b1d5ba6-5655-4663-ab32-305eddfb9461]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 22:08:00,576 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) [2a2ffad5] Checking autorecoverable storage domains done >2012-08-06 22:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) [52b07041] Checking autorecoverable hosts >2012-08-06 22:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) [52b07041] Autorecovering 0 hosts >2012-08-06 22:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) [52b07041] Checking autorecoverable hosts done >2012-08-06 22:10:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) [52b07041] Checking autorecoverable storage domains >2012-08-06 22:10:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) [52b07041] Autorecovering 1 storage domains >2012-08-06 22:10:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) [52b07041] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 22:10:00,031 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-97) [1b38323f] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:10:00,085 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-97) [1b38323f] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 22:10:00,121 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-97) [1b38323f] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:10:00,131 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-97) [1b38323f] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 10:10 PM >2012-08-06 22:10:00,160 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [1b38323f] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 6b90726 >2012-08-06 22:13:00,165 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [1b38323f] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 22:13:00,174 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [1b38323f] FINISH, ConnectStorageServerVDSCommand, log id: 6b90726 >2012-08-06 22:13:00,177 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [1b38323f] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 22:13:00,207 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-97) [1b38323f] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 10:13 PM >2012-08-06 22:13:00,208 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-97) [1b38323f] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 3e42b7a3 >2012-08-06 22:13:00,502 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-97) [1b38323f] Failed in ActivateStorageDomainVDS method >2012-08-06 22:13:00,503 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-97) [1b38323f] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:13:00,505 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) [1b38323f] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:13:00,516 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-97) [1b38323f] FINISH, ActivateStorageDomainVDSCommand, log id: 3e42b7a3 >2012-08-06 22:13:00,519 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-97) [1b38323f] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:13:00,531 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-97) [1b38323f] Command [id=98da2724-82cf-454c-8e67-f62aea193c55]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 22:13:00,594 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) [1b38323f] Checking autorecoverable storage domains done >2012-08-06 22:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts >2012-08-06 22:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering 0 hosts >2012-08-06 22:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts done >2012-08-06 22:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable storage domains >2012-08-06 22:15:00,042 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering 1 storage domains >2012-08-06 22:15:00,045 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 22:15:00,050 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [36d39e06] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:15:00,118 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [36d39e06] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 22:15:00,144 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [36d39e06] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:15:00,150 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [36d39e06] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 10:15 PM >2012-08-06 22:15:00,168 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [36d39e06] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 79ba7c44 >2012-08-06 22:18:00,174 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [36d39e06] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 22:18:00,175 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [36d39e06] FINISH, ConnectStorageServerVDSCommand, log id: 79ba7c44 >2012-08-06 22:18:00,175 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [36d39e06] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 22:18:00,207 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [36d39e06] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 10:18 PM >2012-08-06 22:18:00,208 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-52) [36d39e06] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 695561f4 >2012-08-06 22:18:00,478 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-52) [36d39e06] Failed in ActivateStorageDomainVDS method >2012-08-06 22:18:00,478 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-52) [36d39e06] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:18:00,479 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) [36d39e06] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:18:00,484 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-52) [36d39e06] FINISH, ActivateStorageDomainVDSCommand, log id: 695561f4 >2012-08-06 22:18:00,487 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [36d39e06] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:18:00,497 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [36d39e06] Command [id=b8c50004-382d-4e5c-879b-14032904e044]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 22:18:00,522 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [36d39e06] Checking autorecoverable storage domains done >2012-08-06 22:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) [31568f3b] Checking autorecoverable hosts >2012-08-06 22:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) [31568f3b] Autorecovering 0 hosts >2012-08-06 22:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) [31568f3b] Checking autorecoverable hosts done >2012-08-06 22:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) [31568f3b] Checking autorecoverable storage domains >2012-08-06 22:20:00,062 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) [31568f3b] Autorecovering 1 storage domains >2012-08-06 22:20:00,064 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) [31568f3b] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 22:20:00,073 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-47) [c0f2967] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:20:00,117 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-47) [c0f2967] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 22:20:00,133 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-47) [c0f2967] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:20:00,138 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-47) [c0f2967] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 10:20 PM >2012-08-06 22:20:00,164 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [c0f2967] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 2702ea16 >2012-08-06 22:23:00,167 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [c0f2967] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 22:23:00,168 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [c0f2967] FINISH, ConnectStorageServerVDSCommand, log id: 2702ea16 >2012-08-06 22:23:00,169 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [c0f2967] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 22:23:00,210 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-47) [c0f2967] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 10:23 PM >2012-08-06 22:23:00,211 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-47) [c0f2967] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 38853158 >2012-08-06 22:23:00,472 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-47) [c0f2967] Failed in ActivateStorageDomainVDS method >2012-08-06 22:23:00,473 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-47) [c0f2967] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:23:00,474 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) [c0f2967] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:23:00,503 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-47) [c0f2967] FINISH, ActivateStorageDomainVDSCommand, log id: 38853158 >2012-08-06 22:23:00,506 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-47) [c0f2967] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:23:00,516 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-47) [c0f2967] Command [id=bd5c84d3-731c-4434-86fd-a13d1a63d617]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 22:23:00,537 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) [c0f2967] Checking autorecoverable storage domains done >2012-08-06 22:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) [325397e3] Checking autorecoverable hosts >2012-08-06 22:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) [325397e3] Autorecovering 0 hosts >2012-08-06 22:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) [325397e3] Checking autorecoverable hosts done >2012-08-06 22:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) [325397e3] Checking autorecoverable storage domains >2012-08-06 22:25:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) [325397e3] Autorecovering 1 storage domains >2012-08-06 22:25:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) [325397e3] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 22:25:00,029 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [3fea52a0] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:25:00,087 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [3fea52a0] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 22:25:00,115 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [3fea52a0] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:25:00,116 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [3fea52a0] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 10:25 PM >2012-08-06 22:25:00,130 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [3fea52a0] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 7484f430 >2012-08-06 22:28:00,133 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [3fea52a0] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 22:28:00,134 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [3fea52a0] FINISH, ConnectStorageServerVDSCommand, log id: 7484f430 >2012-08-06 22:28:00,135 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [3fea52a0] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 22:28:00,176 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [3fea52a0] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 10:28 PM >2012-08-06 22:28:00,178 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-33) [3fea52a0] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 2052a238 >2012-08-06 22:28:00,437 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-33) [3fea52a0] Failed in ActivateStorageDomainVDS method >2012-08-06 22:28:00,437 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-33) [3fea52a0] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:28:00,439 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-33) [3fea52a0] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:28:00,444 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-33) [3fea52a0] FINISH, ActivateStorageDomainVDSCommand, log id: 2052a238 >2012-08-06 22:28:00,448 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [3fea52a0] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:28:00,465 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [3fea52a0] Command [id=e5b800ab-0a2b-49cd-848e-03c9f7c4ec58]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 22:28:00,534 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) [3fea52a0] Checking autorecoverable storage domains done >2012-08-06 22:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [291da5cc] Checking autorecoverable hosts >2012-08-06 22:30:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [291da5cc] Autorecovering 0 hosts >2012-08-06 22:30:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [291da5cc] Checking autorecoverable hosts done >2012-08-06 22:30:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [291da5cc] Checking autorecoverable storage domains >2012-08-06 22:30:00,037 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [291da5cc] Autorecovering 1 storage domains >2012-08-06 22:30:00,040 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [291da5cc] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 22:30:00,044 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [943c747] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:30:00,106 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [943c747] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 22:30:00,137 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [943c747] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:30:00,142 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [943c747] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 10:30 PM >2012-08-06 22:30:00,201 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [943c747] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 543bb1b3 >2012-08-06 22:33:00,204 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [943c747] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 22:33:00,205 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [943c747] FINISH, ConnectStorageServerVDSCommand, log id: 543bb1b3 >2012-08-06 22:33:00,206 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [943c747] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 22:33:00,245 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [943c747] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 10:33 PM >2012-08-06 22:33:00,246 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-41) [943c747] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 3e7fb3ae >2012-08-06 22:33:00,543 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-41) [943c747] Failed in ActivateStorageDomainVDS method >2012-08-06 22:33:00,544 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-41) [943c747] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:33:00,545 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) [943c747] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:33:00,556 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-41) [943c747] FINISH, ActivateStorageDomainVDSCommand, log id: 3e7fb3ae >2012-08-06 22:33:00,561 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [943c747] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:33:00,579 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [943c747] Command [id=736114a5-c487-4ac7-813e-47ba4907bddd]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 22:33:00,606 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [943c747] Checking autorecoverable storage domains done >2012-08-06 22:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) [174972f6] Checking autorecoverable hosts >2012-08-06 22:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) [174972f6] Autorecovering 0 hosts >2012-08-06 22:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) [174972f6] Checking autorecoverable hosts done >2012-08-06 22:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) [174972f6] Checking autorecoverable storage domains >2012-08-06 22:35:00,031 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) [174972f6] Autorecovering 1 storage domains >2012-08-06 22:35:00,032 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) [174972f6] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 22:35:00,037 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-8) [18da655a] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:35:00,157 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-8) [18da655a] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 22:35:00,233 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-8) [18da655a] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:35:00,238 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-8) [18da655a] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 10:35 PM >2012-08-06 22:35:00,254 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [18da655a] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 5a882e69 >2012-08-06 22:38:00,258 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [18da655a] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 22:38:00,259 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [18da655a] FINISH, ConnectStorageServerVDSCommand, log id: 5a882e69 >2012-08-06 22:38:00,259 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [18da655a] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 22:38:00,305 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-8) [18da655a] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 10:38 PM >2012-08-06 22:38:00,306 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-8) [18da655a] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 461d7084 >2012-08-06 22:38:00,566 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-8) [18da655a] Failed in ActivateStorageDomainVDS method >2012-08-06 22:38:00,566 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-8) [18da655a] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:38:00,568 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) [18da655a] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:38:00,575 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-8) [18da655a] FINISH, ActivateStorageDomainVDSCommand, log id: 461d7084 >2012-08-06 22:38:00,578 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-8) [18da655a] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:38:00,588 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-8) [18da655a] Command [id=5f5273b3-6f73-4e76-86f8-984a90da0b79]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 22:38:00,626 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) [18da655a] Checking autorecoverable storage domains done >2012-08-06 22:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [632748ee] Checking autorecoverable hosts >2012-08-06 22:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [632748ee] Autorecovering 0 hosts >2012-08-06 22:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [632748ee] Checking autorecoverable hosts done >2012-08-06 22:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [632748ee] Checking autorecoverable storage domains >2012-08-06 22:40:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [632748ee] Autorecovering 1 storage domains >2012-08-06 22:40:00,029 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [632748ee] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 22:40:00,034 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [2d46e7fd] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:40:00,094 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [2d46e7fd] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 22:40:00,118 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [2d46e7fd] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:40:00,128 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [2d46e7fd] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 10:40 PM >2012-08-06 22:40:00,155 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [2d46e7fd] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 4aa32392 >2012-08-06 22:43:00,164 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [2d46e7fd] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 22:43:00,166 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [2d46e7fd] FINISH, ConnectStorageServerVDSCommand, log id: 4aa32392 >2012-08-06 22:43:00,166 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [2d46e7fd] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 22:43:00,196 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [2d46e7fd] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 10:43 PM >2012-08-06 22:43:00,197 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-16) [2d46e7fd] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 1ae12ea3 >2012-08-06 22:43:00,457 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-16) [2d46e7fd] Failed in ActivateStorageDomainVDS method >2012-08-06 22:43:00,458 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-16) [2d46e7fd] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:43:00,461 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [2d46e7fd] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:43:00,468 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-16) [2d46e7fd] FINISH, ActivateStorageDomainVDSCommand, log id: 1ae12ea3 >2012-08-06 22:43:00,472 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [2d46e7fd] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:43:00,482 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [2d46e7fd] Command [id=3a8b0134-8c46-40e0-8c5b-1fb0c226b4a1]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 22:43:00,515 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [2d46e7fd] Checking autorecoverable storage domains done >2012-08-06 22:43:07,312 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-57) DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 22:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) Checking autorecoverable hosts >2012-08-06 22:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) Autorecovering 0 hosts >2012-08-06 22:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) Checking autorecoverable hosts done >2012-08-06 22:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) Checking autorecoverable storage domains >2012-08-06 22:45:00,034 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) Autorecovering 1 storage domains >2012-08-06 22:45:00,035 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 22:45:00,052 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [7637475e] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:45:00,092 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [7637475e] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 22:45:00,143 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [7637475e] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:45:00,144 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [7637475e] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 10:45 PM >2012-08-06 22:45:00,177 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [7637475e] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 19914498 >2012-08-06 22:48:00,182 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [7637475e] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 22:48:00,183 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [7637475e] FINISH, ConnectStorageServerVDSCommand, log id: 19914498 >2012-08-06 22:48:00,183 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [7637475e] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 22:48:00,211 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [7637475e] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 10:48 PM >2012-08-06 22:48:00,212 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-51) [7637475e] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 6ef10d74 >2012-08-06 22:48:00,491 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-51) [7637475e] Failed in ActivateStorageDomainVDS method >2012-08-06 22:48:00,492 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-51) [7637475e] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:48:00,495 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-51) [7637475e] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:48:00,508 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-51) [7637475e] FINISH, ActivateStorageDomainVDSCommand, log id: 6ef10d74 >2012-08-06 22:48:00,512 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [7637475e] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:48:00,528 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [7637475e] Command [id=29c9bff4-4443-42f7-9a36-0858ef7ef81d]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 22:48:00,559 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [7637475e] Checking autorecoverable storage domains done >2012-08-06 22:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) [3fea52a0] Checking autorecoverable hosts >2012-08-06 22:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) [3fea52a0] Autorecovering 0 hosts >2012-08-06 22:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) [3fea52a0] Checking autorecoverable hosts done >2012-08-06 22:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) [3fea52a0] Checking autorecoverable storage domains >2012-08-06 22:50:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) [3fea52a0] Autorecovering 1 storage domains >2012-08-06 22:50:00,029 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) [3fea52a0] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 22:50:00,037 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [7900944a] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:50:00,093 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [7900944a] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 22:50:00,110 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [7900944a] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:50:00,115 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [7900944a] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 10:50 PM >2012-08-06 22:50:00,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [7900944a] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 4463b4cc >2012-08-06 22:53:00,138 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [7900944a] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 22:53:00,139 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [7900944a] FINISH, ConnectStorageServerVDSCommand, log id: 4463b4cc >2012-08-06 22:53:00,142 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [7900944a] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 22:53:00,189 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [7900944a] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 10:53 PM >2012-08-06 22:53:00,190 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-33) [7900944a] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 56c49e67 >2012-08-06 22:53:00,454 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-33) [7900944a] Failed in ActivateStorageDomainVDS method >2012-08-06 22:53:00,455 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-33) [7900944a] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:53:00,456 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-33) [7900944a] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:53:00,459 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-33) [7900944a] FINISH, ActivateStorageDomainVDSCommand, log id: 56c49e67 >2012-08-06 22:53:00,462 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [7900944a] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:53:00,473 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [7900944a] Command [id=5d48fbf8-b410-424c-9536-63309a504c97]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 22:53:00,537 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) [7900944a] Checking autorecoverable storage domains done >2012-08-06 22:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Checking autorecoverable hosts >2012-08-06 22:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Autorecovering 0 hosts >2012-08-06 22:55:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Checking autorecoverable hosts done >2012-08-06 22:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Checking autorecoverable storage domains >2012-08-06 22:55:00,021 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Autorecovering 1 storage domains >2012-08-06 22:55:00,025 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 22:55:00,035 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-75) [75461eb4] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:55:00,103 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-75) [75461eb4] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 22:55:00,119 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-75) [75461eb4] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 22:55:00,123 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-75) [75461eb4] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 10:55 PM >2012-08-06 22:55:00,139 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [75461eb4] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 252c93cf >2012-08-06 22:58:00,143 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [75461eb4] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 22:58:00,145 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [75461eb4] FINISH, ConnectStorageServerVDSCommand, log id: 252c93cf >2012-08-06 22:58:00,145 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [75461eb4] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 22:58:00,175 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-75) [75461eb4] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 10:58 PM >2012-08-06 22:58:00,176 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-75) [75461eb4] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 1eb162de >2012-08-06 22:58:00,429 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-75) [75461eb4] Failed in ActivateStorageDomainVDS method >2012-08-06 22:58:00,429 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-75) [75461eb4] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:58:00,432 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [75461eb4] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:58:00,439 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-75) [75461eb4] FINISH, ActivateStorageDomainVDSCommand, log id: 1eb162de >2012-08-06 22:58:00,443 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-75) [75461eb4] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 22:58:00,463 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-75) [75461eb4] Command [id=0e363f9e-788a-4bca-88a5-90bcdd2bb42d]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 22:58:00,489 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) [75461eb4] Checking autorecoverable storage domains done >2012-08-06 23:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable hosts >2012-08-06 23:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering 0 hosts >2012-08-06 23:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable hosts done >2012-08-06 23:00:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable storage domains >2012-08-06 23:00:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering 1 storage domains >2012-08-06 23:00:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 23:00:00,026 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [7a91f87b] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:00:00,065 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [7a91f87b] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 23:00:00,084 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [7a91f87b] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:00:00,085 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [7a91f87b] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 11:00 PM >2012-08-06 23:00:00,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [7a91f87b] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: ad055a1 >2012-08-06 23:03:00,102 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [7a91f87b] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 23:03:00,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [7a91f87b] FINISH, ConnectStorageServerVDSCommand, log id: ad055a1 >2012-08-06 23:03:00,104 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [7a91f87b] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 23:03:00,137 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [7a91f87b] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 11:03 PM >2012-08-06 23:03:00,138 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-22) [7a91f87b] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 4cfbe424 >2012-08-06 23:03:00,416 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-22) [7a91f87b] Failed in ActivateStorageDomainVDS method >2012-08-06 23:03:00,416 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-22) [7a91f87b] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:03:00,418 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) [7a91f87b] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:03:00,423 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-22) [7a91f87b] FINISH, ActivateStorageDomainVDSCommand, log id: 4cfbe424 >2012-08-06 23:03:00,427 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [7a91f87b] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:03:00,437 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [7a91f87b] Command [id=817e182d-6264-4eb2-8258-350c487c8e17]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 23:03:00,499 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) [7a91f87b] Checking autorecoverable storage domains done >2012-08-06 23:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) [1861770c] Checking autorecoverable hosts >2012-08-06 23:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) [1861770c] Autorecovering 0 hosts >2012-08-06 23:05:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) [1861770c] Checking autorecoverable hosts done >2012-08-06 23:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) [1861770c] Checking autorecoverable storage domains >2012-08-06 23:05:00,034 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) [1861770c] Autorecovering 1 storage domains >2012-08-06 23:05:00,037 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) [1861770c] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 23:05:00,041 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-14) [50a3eaa3] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:05:00,095 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-14) [50a3eaa3] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 23:05:00,126 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-14) [50a3eaa3] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:05:00,130 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-14) [50a3eaa3] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 11:05 PM >2012-08-06 23:05:00,146 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [50a3eaa3] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 31cb999d >2012-08-06 23:08:00,150 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [50a3eaa3] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 23:08:00,151 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [50a3eaa3] FINISH, ConnectStorageServerVDSCommand, log id: 31cb999d >2012-08-06 23:08:00,152 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [50a3eaa3] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 23:08:00,184 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-14) [50a3eaa3] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 11:08 PM >2012-08-06 23:08:00,187 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-14) [50a3eaa3] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 3b9aebd3 >2012-08-06 23:08:00,470 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-14) [50a3eaa3] Failed in ActivateStorageDomainVDS method >2012-08-06 23:08:00,471 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-14) [50a3eaa3] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:08:00,472 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-14) [50a3eaa3] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:08:00,475 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-14) [50a3eaa3] FINISH, ActivateStorageDomainVDSCommand, log id: 3b9aebd3 >2012-08-06 23:08:00,478 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-14) [50a3eaa3] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:08:00,492 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-14) [50a3eaa3] Command [id=bd161231-c0d5-40ca-af27-2360f2edd76a]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 23:08:00,553 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) [50a3eaa3] Checking autorecoverable storage domains done >2012-08-06 23:09:59,999 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [1bfcbc57] Checking autorecoverable hosts >2012-08-06 23:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [1bfcbc57] Autorecovering 0 hosts >2012-08-06 23:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [1bfcbc57] Checking autorecoverable hosts done >2012-08-06 23:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [1bfcbc57] Checking autorecoverable storage domains >2012-08-06 23:10:00,046 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [1bfcbc57] Autorecovering 1 storage domains >2012-08-06 23:10:00,047 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [1bfcbc57] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 23:10:00,051 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [45a41b8f] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:10:00,109 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [45a41b8f] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 23:10:00,145 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [45a41b8f] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:10:00,149 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [45a41b8f] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 11:10 PM >2012-08-06 23:10:00,189 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [45a41b8f] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 51f4352e >2012-08-06 23:13:00,193 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [45a41b8f] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 23:13:00,194 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [45a41b8f] FINISH, ConnectStorageServerVDSCommand, log id: 51f4352e >2012-08-06 23:13:00,195 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [45a41b8f] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 23:13:00,226 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [45a41b8f] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 11:13 PM >2012-08-06 23:13:00,227 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-55) [45a41b8f] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 2c6f42cc >2012-08-06 23:13:00,491 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-55) [45a41b8f] Failed in ActivateStorageDomainVDS method >2012-08-06 23:13:00,492 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-55) [45a41b8f] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:13:00,493 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-55) [45a41b8f] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:13:00,501 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-55) [45a41b8f] FINISH, ActivateStorageDomainVDSCommand, log id: 2c6f42cc >2012-08-06 23:13:00,505 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [45a41b8f] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:13:00,516 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [45a41b8f] Command [id=7c1017c3-e9c1-4869-a57f-a2eccb4afaf3]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 23:13:00,556 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [45a41b8f] Checking autorecoverable storage domains done >2012-08-06 23:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [7d34aeac] Checking autorecoverable hosts >2012-08-06 23:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [7d34aeac] Autorecovering 0 hosts >2012-08-06 23:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [7d34aeac] Checking autorecoverable hosts done >2012-08-06 23:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [7d34aeac] Checking autorecoverable storage domains >2012-08-06 23:15:00,039 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [7d34aeac] Autorecovering 1 storage domains >2012-08-06 23:15:00,042 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [7d34aeac] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 23:15:00,046 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-5) [1f8f4fe3] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:15:00,094 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-5) [1f8f4fe3] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 23:15:00,113 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-5) [1f8f4fe3] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:15:00,115 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-5) [1f8f4fe3] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 11:15 PM >2012-08-06 23:15:00,142 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [1f8f4fe3] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: d3564 >2012-08-06 23:18:00,147 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [1f8f4fe3] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 23:18:00,149 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [1f8f4fe3] FINISH, ConnectStorageServerVDSCommand, log id: d3564 >2012-08-06 23:18:00,152 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [1f8f4fe3] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 23:18:00,184 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-5) [1f8f4fe3] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 11:18 PM >2012-08-06 23:18:00,185 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-5) [1f8f4fe3] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 4a1b894d >2012-08-06 23:18:00,458 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-5) [1f8f4fe3] Failed in ActivateStorageDomainVDS method >2012-08-06 23:18:00,458 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-5) [1f8f4fe3] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:18:00,462 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-5) [1f8f4fe3] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:18:00,466 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-5) [1f8f4fe3] FINISH, ActivateStorageDomainVDSCommand, log id: 4a1b894d >2012-08-06 23:18:00,470 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-5) [1f8f4fe3] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:18:00,487 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-5) [1f8f4fe3] Command [id=b59c5a80-497b-4476-a510-63e47eac0467]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 23:18:00,510 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [1f8f4fe3] Checking autorecoverable storage domains done >2012-08-06 23:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Checking autorecoverable hosts >2012-08-06 23:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Autorecovering 0 hosts >2012-08-06 23:20:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Checking autorecoverable hosts done >2012-08-06 23:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Checking autorecoverable storage domains >2012-08-06 23:20:00,030 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Autorecovering 1 storage domains >2012-08-06 23:20:00,033 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 23:20:00,041 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-4) [6333ff61] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:20:00,081 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-4) [6333ff61] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 23:20:00,097 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-4) [6333ff61] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:20:00,102 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-4) [6333ff61] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 11:20 PM >2012-08-06 23:20:00,119 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [6333ff61] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 2f37c3b6 >2012-08-06 23:23:00,122 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [6333ff61] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 23:23:00,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [6333ff61] FINISH, ConnectStorageServerVDSCommand, log id: 2f37c3b6 >2012-08-06 23:23:00,125 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [6333ff61] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 23:23:00,155 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-4) [6333ff61] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 11:23 PM >2012-08-06 23:23:00,156 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-4) [6333ff61] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 13340998 >2012-08-06 23:23:00,437 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-4) [6333ff61] Failed in ActivateStorageDomainVDS method >2012-08-06 23:23:00,438 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-4) [6333ff61] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:23:00,440 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-4) [6333ff61] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:23:00,447 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-4) [6333ff61] FINISH, ActivateStorageDomainVDSCommand, log id: 13340998 >2012-08-06 23:23:00,451 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-4) [6333ff61] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:23:00,467 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-4) [6333ff61] Command [id=d64f1894-7827-482d-badb-aa59e30bf4cb]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 23:23:00,495 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) [6333ff61] Checking autorecoverable storage domains done >2012-08-06 23:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) [452f996d] Checking autorecoverable hosts >2012-08-06 23:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) [452f996d] Autorecovering 0 hosts >2012-08-06 23:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) [452f996d] Checking autorecoverable hosts done >2012-08-06 23:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) [452f996d] Checking autorecoverable storage domains >2012-08-06 23:25:00,035 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) [452f996d] Autorecovering 1 storage domains >2012-08-06 23:25:00,038 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) [452f996d] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 23:25:00,046 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-18) [4bc24d3] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:25:00,095 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-18) [4bc24d3] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 23:25:00,112 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-18) [4bc24d3] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:25:00,116 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-18) [4bc24d3] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 11:25 PM >2012-08-06 23:25:00,132 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [4bc24d3] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 6c98d9d2 >2012-08-06 23:28:00,138 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [4bc24d3] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 23:28:00,139 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [4bc24d3] FINISH, ConnectStorageServerVDSCommand, log id: 6c98d9d2 >2012-08-06 23:28:00,140 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [4bc24d3] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 23:28:00,170 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-18) [4bc24d3] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 11:28 PM >2012-08-06 23:28:00,171 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-18) [4bc24d3] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 10260f1b >2012-08-06 23:28:00,427 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-18) [4bc24d3] Failed in ActivateStorageDomainVDS method >2012-08-06 23:28:00,427 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-18) [4bc24d3] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:28:00,428 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-18) [4bc24d3] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:28:00,434 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-18) [4bc24d3] FINISH, ActivateStorageDomainVDSCommand, log id: 10260f1b >2012-08-06 23:28:00,437 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-18) [4bc24d3] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:28:00,447 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-18) [4bc24d3] Command [id=7e495605-d580-47d0-9d6b-5bbaf66b3296]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 23:28:00,478 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) [4bc24d3] Checking autorecoverable storage domains done >2012-08-06 23:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [2d46e7fd] Checking autorecoverable hosts >2012-08-06 23:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [2d46e7fd] Autorecovering 0 hosts >2012-08-06 23:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [2d46e7fd] Checking autorecoverable hosts done >2012-08-06 23:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [2d46e7fd] Checking autorecoverable storage domains >2012-08-06 23:30:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [2d46e7fd] Autorecovering 1 storage domains >2012-08-06 23:30:00,030 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [2d46e7fd] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 23:30:00,035 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [10bbc57c] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:30:00,073 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [10bbc57c] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 23:30:00,091 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [10bbc57c] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:30:00,095 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [10bbc57c] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 11:30 PM >2012-08-06 23:30:00,111 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [10bbc57c] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 776618c3 >2012-08-06 23:33:00,115 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [10bbc57c] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 23:33:00,116 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [10bbc57c] FINISH, ConnectStorageServerVDSCommand, log id: 776618c3 >2012-08-06 23:33:00,116 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [10bbc57c] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 23:33:00,149 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [10bbc57c] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 11:33 PM >2012-08-06 23:33:00,150 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-16) [10bbc57c] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 5495bf19 >2012-08-06 23:33:00,412 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-16) [10bbc57c] Failed in ActivateStorageDomainVDS method >2012-08-06 23:33:00,412 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-16) [10bbc57c] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:33:00,415 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [10bbc57c] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:33:00,423 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-16) [10bbc57c] FINISH, ActivateStorageDomainVDSCommand, log id: 5495bf19 >2012-08-06 23:33:00,426 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [10bbc57c] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:33:00,443 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [10bbc57c] Command [id=8a6d5670-cb7e-410d-81d0-d2b2acd5b59e]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 23:33:00,463 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [10bbc57c] Checking autorecoverable storage domains done >2012-08-06 23:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [3b095c2] Checking autorecoverable hosts >2012-08-06 23:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [3b095c2] Autorecovering 0 hosts >2012-08-06 23:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [3b095c2] Checking autorecoverable hosts done >2012-08-06 23:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [3b095c2] Checking autorecoverable storage domains >2012-08-06 23:35:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [3b095c2] Autorecovering 1 storage domains >2012-08-06 23:35:00,022 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [3b095c2] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 23:35:00,026 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [6325a812] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:35:00,067 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [6325a812] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 23:35:00,091 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [6325a812] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:35:00,092 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [6325a812] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 11:35 PM >2012-08-06 23:35:00,115 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [6325a812] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 4e25d0f2 >2012-08-06 23:38:00,119 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [6325a812] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 23:38:00,120 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [6325a812] FINISH, ConnectStorageServerVDSCommand, log id: 4e25d0f2 >2012-08-06 23:38:00,121 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [6325a812] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 23:38:00,162 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [6325a812] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 11:38 PM >2012-08-06 23:38:00,163 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-72) [6325a812] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 32bd0bbb >2012-08-06 23:38:00,418 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-72) [6325a812] Failed in ActivateStorageDomainVDS method >2012-08-06 23:38:00,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-72) [6325a812] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:38:00,423 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-72) [6325a812] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:38:00,430 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-72) [6325a812] FINISH, ActivateStorageDomainVDSCommand, log id: 32bd0bbb >2012-08-06 23:38:00,433 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [6325a812] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:38:00,449 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [6325a812] Command [id=190a8b7d-8fd7-421e-a1c8-f91cfd6dd578]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 23:38:00,483 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [6325a812] Checking autorecoverable storage domains done >2012-08-06 23:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable hosts >2012-08-06 23:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Autorecovering 0 hosts >2012-08-06 23:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable hosts done >2012-08-06 23:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable storage domains >2012-08-06 23:40:00,036 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Autorecovering 1 storage domains >2012-08-06 23:40:00,039 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 23:40:00,043 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [2aa3a675] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:40:00,106 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [2aa3a675] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 23:40:00,124 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [2aa3a675] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:40:00,125 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [2aa3a675] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 11:40 PM >2012-08-06 23:40:00,139 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [2aa3a675] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: a70843f >2012-08-06 23:43:00,149 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [2aa3a675] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 23:43:00,150 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [2aa3a675] FINISH, ConnectStorageServerVDSCommand, log id: a70843f >2012-08-06 23:43:00,154 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [2aa3a675] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 23:43:00,183 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [2aa3a675] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 11:43 PM >2012-08-06 23:43:00,184 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-74) [2aa3a675] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 7c1986b4 >2012-08-06 23:43:00,438 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-74) [2aa3a675] Failed in ActivateStorageDomainVDS method >2012-08-06 23:43:00,439 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-74) [2aa3a675] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:43:00,443 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [2aa3a675] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:43:00,450 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-74) [2aa3a675] FINISH, ActivateStorageDomainVDSCommand, log id: 7c1986b4 >2012-08-06 23:43:00,453 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [2aa3a675] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:43:00,463 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [2aa3a675] Command [id=d72f2046-dbde-418d-8140-2b19bcb754a9]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 23:43:00,484 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) [2aa3a675] Checking autorecoverable storage domains done >2012-08-06 23:43:07,315 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-89) [44f3adb7] DbUserCacheManager::refreshAllUserData() - entered >2012-08-06 23:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) Checking autorecoverable hosts >2012-08-06 23:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) Autorecovering 0 hosts >2012-08-06 23:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) Checking autorecoverable hosts done >2012-08-06 23:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) Checking autorecoverable storage domains >2012-08-06 23:45:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) Autorecovering 1 storage domains >2012-08-06 23:45:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 23:45:00,024 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-99) [2c7a90fe] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:45:00,074 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-99) [2c7a90fe] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 23:45:00,108 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-99) [2c7a90fe] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:45:00,109 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-99) [2c7a90fe] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 11:45 PM >2012-08-06 23:45:00,132 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [2c7a90fe] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 117419ad >2012-08-06 23:48:00,137 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [2c7a90fe] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 23:48:00,138 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [2c7a90fe] FINISH, ConnectStorageServerVDSCommand, log id: 117419ad >2012-08-06 23:48:00,139 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [2c7a90fe] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 23:48:00,170 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-99) [2c7a90fe] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 11:48 PM >2012-08-06 23:48:00,171 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-99) [2c7a90fe] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 142b1586 >2012-08-06 23:48:00,423 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-99) [2c7a90fe] Failed in ActivateStorageDomainVDS method >2012-08-06 23:48:00,424 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-99) [2c7a90fe] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:48:00,426 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) [2c7a90fe] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:48:00,434 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-99) [2c7a90fe] FINISH, ActivateStorageDomainVDSCommand, log id: 142b1586 >2012-08-06 23:48:00,438 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-99) [2c7a90fe] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:48:00,452 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-99) [2c7a90fe] Command [id=1e9b4f40-efa3-4ae0-9d08-4ccf037ed91e]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 23:48:00,514 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [2c7a90fe] Checking autorecoverable storage domains done >2012-08-06 23:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [42a7a8dc] Checking autorecoverable hosts >2012-08-06 23:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [42a7a8dc] Autorecovering 0 hosts >2012-08-06 23:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [42a7a8dc] Checking autorecoverable hosts done >2012-08-06 23:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [42a7a8dc] Checking autorecoverable storage domains >2012-08-06 23:50:00,033 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [42a7a8dc] Autorecovering 1 storage domains >2012-08-06 23:50:00,036 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [42a7a8dc] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 23:50:00,046 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [2387f4b5] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:50:00,093 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [2387f4b5] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 23:50:00,120 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [2387f4b5] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:50:00,121 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [2387f4b5] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 11:50 PM >2012-08-06 23:50:00,139 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [2387f4b5] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 1f5eb0af >2012-08-06 23:53:00,143 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [2387f4b5] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 23:53:00,144 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [2387f4b5] FINISH, ConnectStorageServerVDSCommand, log id: 1f5eb0af >2012-08-06 23:53:00,145 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [2387f4b5] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 23:53:00,173 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [2387f4b5] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 11:53 PM >2012-08-06 23:53:00,174 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-12) [2387f4b5] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 2cf9dd33 >2012-08-06 23:53:00,429 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-12) [2387f4b5] Failed in ActivateStorageDomainVDS method >2012-08-06 23:53:00,430 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-12) [2387f4b5] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:53:00,431 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) [2387f4b5] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:53:00,439 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-12) [2387f4b5] FINISH, ActivateStorageDomainVDSCommand, log id: 2cf9dd33 >2012-08-06 23:53:00,442 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [2387f4b5] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:53:00,453 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [2387f4b5] Command [id=0fdee67e-0db3-4c06-9ab4-a22c0367aded]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 23:53:00,488 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [2387f4b5] Checking autorecoverable storage domains done >2012-08-06 23:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [6af66fb0] Checking autorecoverable hosts >2012-08-06 23:55:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [6af66fb0] Autorecovering 0 hosts >2012-08-06 23:55:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [6af66fb0] Checking autorecoverable hosts done >2012-08-06 23:55:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [6af66fb0] Checking autorecoverable storage domains >2012-08-06 23:55:00,041 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [6af66fb0] Autorecovering 1 storage domains >2012-08-06 23:55:00,041 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [6af66fb0] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-06 23:55:00,046 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-64) [2a3f36da] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:55:00,145 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-64) [2a3f36da] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-06 23:55:00,170 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-64) [2a3f36da] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-06 23:55:00,171 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-64) [2a3f36da] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/6/12 11:55 PM >2012-08-06 23:55:00,194 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [2a3f36da] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 1d59d221 >2012-08-06 23:58:00,201 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [2a3f36da] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-06 23:58:00,203 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [2a3f36da] FINISH, ConnectStorageServerVDSCommand, log id: 1d59d221 >2012-08-06 23:58:00,203 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [2a3f36da] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-06 23:58:00,234 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-64) [2a3f36da] ActivateStorage Domain. After Connect all hosts to pool. Time:8/6/12 11:58 PM >2012-08-06 23:58:00,235 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-64) [2a3f36da] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 676cc24d >2012-08-06 23:58:00,490 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-64) [2a3f36da] Failed in ActivateStorageDomainVDS method >2012-08-06 23:58:00,491 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-64) [2a3f36da] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:58:00,492 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-64) [2a3f36da] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:58:00,498 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-64) [2a3f36da] FINISH, ActivateStorageDomainVDSCommand, log id: 676cc24d >2012-08-06 23:58:00,502 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-64) [2a3f36da] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-06 23:58:00,517 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-64) [2a3f36da] Command [id=02da9a0b-3121-41e0-aabd-a39337c8bd40]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-06 23:58:00,568 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [2a3f36da] Checking autorecoverable storage domains done >2012-08-07 00:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) [47c8ae26] Checking autorecoverable hosts >2012-08-07 00:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) [47c8ae26] Autorecovering 0 hosts >2012-08-07 00:00:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) [47c8ae26] Checking autorecoverable hosts done >2012-08-07 00:00:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) [47c8ae26] Checking autorecoverable storage domains >2012-08-07 00:00:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) [47c8ae26] Autorecovering 1 storage domains >2012-08-07 00:00:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) [47c8ae26] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 00:00:00,028 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [5ffcde86] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:00:00,076 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [5ffcde86] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 00:00:00,090 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [5ffcde86] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:00:00,094 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [5ffcde86] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:00 AM >2012-08-07 00:00:00,111 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [5ffcde86] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 4ee9a8cc >2012-08-07 00:03:00,121 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [5ffcde86] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 00:03:00,122 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [5ffcde86] FINISH, ConnectStorageServerVDSCommand, log id: 4ee9a8cc >2012-08-07 00:03:00,123 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [5ffcde86] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 00:03:00,155 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [5ffcde86] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:03 AM >2012-08-07 00:03:00,158 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-92) [5ffcde86] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: c1e9632 >2012-08-07 00:03:00,435 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-92) [5ffcde86] Failed in ActivateStorageDomainVDS method >2012-08-07 00:03:00,435 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-92) [5ffcde86] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:03:00,437 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-92) [5ffcde86] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:03:00,442 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-92) [5ffcde86] FINISH, ActivateStorageDomainVDSCommand, log id: c1e9632 >2012-08-07 00:03:00,445 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [5ffcde86] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:03:00,456 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [5ffcde86] Command [id=4d3401e2-b315-45ed-9be4-bef980ac581b]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 00:03:00,483 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) [5ffcde86] Checking autorecoverable storage domains done >2012-08-07 00:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Checking autorecoverable hosts >2012-08-07 00:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Autorecovering 0 hosts >2012-08-07 00:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Checking autorecoverable hosts done >2012-08-07 00:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Checking autorecoverable storage domains >2012-08-07 00:05:00,025 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Autorecovering 1 storage domains >2012-08-07 00:05:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 00:05:00,031 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-71) [68a3eeac] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:05:00,119 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-71) [68a3eeac] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 00:05:00,147 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-71) [68a3eeac] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:05:00,151 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-71) [68a3eeac] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:05 AM >2012-08-07 00:05:00,168 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [68a3eeac] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 6adc712 >2012-08-07 00:08:00,172 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [68a3eeac] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 00:08:00,173 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [68a3eeac] FINISH, ConnectStorageServerVDSCommand, log id: 6adc712 >2012-08-07 00:08:00,175 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [68a3eeac] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 00:08:00,207 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-71) [68a3eeac] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:08 AM >2012-08-07 00:08:00,208 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-71) [68a3eeac] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 7a8fee75 >2012-08-07 00:08:00,476 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-71) [68a3eeac] Failed in ActivateStorageDomainVDS method >2012-08-07 00:08:00,476 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-71) [68a3eeac] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:08:00,478 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-71) [68a3eeac] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:08:00,485 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-71) [68a3eeac] FINISH, ActivateStorageDomainVDSCommand, log id: 7a8fee75 >2012-08-07 00:08:00,489 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-71) [68a3eeac] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:08:00,500 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-71) [68a3eeac] Command [id=b76c95aa-0d36-42dc-9d26-7ff0e62c0fac]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 00:08:00,621 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) [68a3eeac] Checking autorecoverable storage domains done >2012-08-07 00:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Checking autorecoverable hosts >2012-08-07 00:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Autorecovering 0 hosts >2012-08-07 00:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Checking autorecoverable hosts done >2012-08-07 00:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Checking autorecoverable storage domains >2012-08-07 00:10:00,068 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Autorecovering 1 storage domains >2012-08-07 00:10:00,070 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 00:10:00,074 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [393cf792] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:10:00,133 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [393cf792] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 00:10:00,151 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [393cf792] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:10:00,157 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [393cf792] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:10 AM >2012-08-07 00:10:00,174 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [393cf792] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: b5ce61f >2012-08-07 00:13:00,177 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [393cf792] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 00:13:00,179 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [393cf792] FINISH, ConnectStorageServerVDSCommand, log id: b5ce61f >2012-08-07 00:13:00,179 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [393cf792] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 00:13:00,210 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [393cf792] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:13 AM >2012-08-07 00:13:00,212 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-29) [393cf792] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 3aa3c5d5 >2012-08-07 00:13:00,475 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-29) [393cf792] Failed in ActivateStorageDomainVDS method >2012-08-07 00:13:00,476 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-29) [393cf792] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:13:00,478 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-29) [393cf792] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:13:00,486 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-29) [393cf792] FINISH, ActivateStorageDomainVDSCommand, log id: 3aa3c5d5 >2012-08-07 00:13:00,490 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [393cf792] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:13:00,500 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [393cf792] Command [id=f56e7467-e289-4e6a-8ee3-eed16ce9a28b]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 00:13:00,522 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [393cf792] Checking autorecoverable storage domains done >2012-08-07 00:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [7637475e] Checking autorecoverable hosts >2012-08-07 00:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [7637475e] Autorecovering 0 hosts >2012-08-07 00:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [7637475e] Checking autorecoverable hosts done >2012-08-07 00:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [7637475e] Checking autorecoverable storage domains >2012-08-07 00:15:00,036 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [7637475e] Autorecovering 1 storage domains >2012-08-07 00:15:00,038 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [7637475e] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 00:15:00,043 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [58ed0184] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:15:00,090 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [58ed0184] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 00:15:00,124 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [58ed0184] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:15:00,125 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [58ed0184] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:15 AM >2012-08-07 00:15:00,144 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [58ed0184] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 6775e793 >2012-08-07 00:18:00,147 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [58ed0184] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 00:18:00,148 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [58ed0184] FINISH, ConnectStorageServerVDSCommand, log id: 6775e793 >2012-08-07 00:18:00,152 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [58ed0184] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 00:18:00,187 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [58ed0184] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:18 AM >2012-08-07 00:18:00,188 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-51) [58ed0184] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 547b8c24 >2012-08-07 00:18:00,441 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-51) [58ed0184] Failed in ActivateStorageDomainVDS method >2012-08-07 00:18:00,442 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-51) [58ed0184] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:18:00,444 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-51) [58ed0184] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:18:00,451 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-51) [58ed0184] FINISH, ActivateStorageDomainVDSCommand, log id: 547b8c24 >2012-08-07 00:18:00,455 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [58ed0184] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:18:00,465 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [58ed0184] Command [id=211ab0f7-cda5-471d-82d5-5e83be474e46]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 00:18:00,486 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [58ed0184] Checking autorecoverable storage domains done >2012-08-07 00:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) [5d8c68c] Checking autorecoverable hosts >2012-08-07 00:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) [5d8c68c] Autorecovering 0 hosts >2012-08-07 00:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) [5d8c68c] Checking autorecoverable hosts done >2012-08-07 00:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) [5d8c68c] Checking autorecoverable storage domains >2012-08-07 00:20:00,034 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) [5d8c68c] Autorecovering 1 storage domains >2012-08-07 00:20:00,038 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) [5d8c68c] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 00:20:00,047 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-50) [6c0929bf] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:20:00,125 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-50) [6c0929bf] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 00:20:00,151 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-50) [6c0929bf] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:20:00,155 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-50) [6c0929bf] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:20 AM >2012-08-07 00:20:00,170 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [6c0929bf] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 36a06dcf >2012-08-07 00:23:00,175 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [6c0929bf] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 00:23:00,180 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [6c0929bf] FINISH, ConnectStorageServerVDSCommand, log id: 36a06dcf >2012-08-07 00:23:00,185 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [6c0929bf] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 00:23:00,219 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-50) [6c0929bf] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:23 AM >2012-08-07 00:23:00,220 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-50) [6c0929bf] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 6125c2e4 >2012-08-07 00:23:00,479 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-50) [6c0929bf] Failed in ActivateStorageDomainVDS method >2012-08-07 00:23:00,479 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-50) [6c0929bf] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:23:00,483 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) [6c0929bf] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:23:00,489 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-50) [6c0929bf] FINISH, ActivateStorageDomainVDSCommand, log id: 6125c2e4 >2012-08-07 00:23:00,492 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-50) [6c0929bf] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:23:00,503 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-50) [6c0929bf] Command [id=65158970-5017-455a-9fdd-b0a245a28517]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 00:23:00,534 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) [6c0929bf] Checking autorecoverable storage domains done >2012-08-07 00:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) Checking autorecoverable hosts >2012-08-07 00:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) Autorecovering 0 hosts >2012-08-07 00:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) Checking autorecoverable hosts done >2012-08-07 00:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) Checking autorecoverable storage domains >2012-08-07 00:25:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) Autorecovering 1 storage domains >2012-08-07 00:25:00,029 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 00:25:00,034 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [11a13a35] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:25:00,087 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [11a13a35] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 00:25:00,109 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [11a13a35] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:25:00,112 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [11a13a35] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:25 AM >2012-08-07 00:25:00,149 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [11a13a35] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 1991721 >2012-08-07 00:28:00,161 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [11a13a35] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 00:28:00,162 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [11a13a35] FINISH, ConnectStorageServerVDSCommand, log id: 1991721 >2012-08-07 00:28:00,168 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [11a13a35] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 00:28:00,211 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [11a13a35] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:28 AM >2012-08-07 00:28:00,212 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-7) [11a13a35] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 632453ec >2012-08-07 00:28:00,464 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-7) [11a13a35] Failed in ActivateStorageDomainVDS method >2012-08-07 00:28:00,465 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-7) [11a13a35] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:28:00,466 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-7) [11a13a35] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:28:00,482 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-7) [11a13a35] FINISH, ActivateStorageDomainVDSCommand, log id: 632453ec >2012-08-07 00:28:00,487 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [11a13a35] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:28:00,503 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [11a13a35] Command [id=a9e46a1e-c455-43cc-aba8-f65b55cb95bb]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 00:28:00,529 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [11a13a35] Checking autorecoverable storage domains done >2012-08-07 00:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable hosts >2012-08-07 00:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Autorecovering 0 hosts >2012-08-07 00:30:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable hosts done >2012-08-07 00:30:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable storage domains >2012-08-07 00:30:00,042 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Autorecovering 1 storage domains >2012-08-07 00:30:00,044 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 00:30:00,048 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-20) [3f5b95e0] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:30:00,102 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-20) [3f5b95e0] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 00:30:00,124 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-20) [3f5b95e0] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:30:00,128 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-20) [3f5b95e0] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:30 AM >2012-08-07 00:30:00,160 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [3f5b95e0] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 1765c6b >2012-08-07 00:33:00,164 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [3f5b95e0] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 00:33:00,167 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [3f5b95e0] FINISH, ConnectStorageServerVDSCommand, log id: 1765c6b >2012-08-07 00:33:00,171 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [3f5b95e0] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 00:33:00,200 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-20) [3f5b95e0] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:33 AM >2012-08-07 00:33:00,201 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-20) [3f5b95e0] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 507d42a5 >2012-08-07 00:33:00,458 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-20) [3f5b95e0] Failed in ActivateStorageDomainVDS method >2012-08-07 00:33:00,458 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-20) [3f5b95e0] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:33:00,462 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) [3f5b95e0] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:33:00,469 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-20) [3f5b95e0] FINISH, ActivateStorageDomainVDSCommand, log id: 507d42a5 >2012-08-07 00:33:00,473 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-20) [3f5b95e0] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:33:00,488 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-20) [3f5b95e0] Command [id=1c22deb7-eb31-41ba-a23c-8bd8366f8be8]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 00:33:00,514 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) [3f5b95e0] Checking autorecoverable storage domains done >2012-08-07 00:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) [3f9e331a] Checking autorecoverable hosts >2012-08-07 00:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) [3f9e331a] Autorecovering 0 hosts >2012-08-07 00:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) [3f9e331a] Checking autorecoverable hosts done >2012-08-07 00:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) [3f9e331a] Checking autorecoverable storage domains >2012-08-07 00:35:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) [3f9e331a] Autorecovering 1 storage domains >2012-08-07 00:35:00,034 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) [3f9e331a] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 00:35:00,041 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-10) [76168fe0] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:35:00,098 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-10) [76168fe0] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 00:35:00,122 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-10) [76168fe0] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:35:00,123 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-10) [76168fe0] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:35 AM >2012-08-07 00:35:00,137 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [76168fe0] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 29d246a1 >2012-08-07 00:38:00,142 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [76168fe0] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 00:38:00,143 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [76168fe0] FINISH, ConnectStorageServerVDSCommand, log id: 29d246a1 >2012-08-07 00:38:00,144 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [76168fe0] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 00:38:00,175 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-10) [76168fe0] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:38 AM >2012-08-07 00:38:00,176 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-10) [76168fe0] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 6d0fde89 >2012-08-07 00:38:00,427 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-10) [76168fe0] Failed in ActivateStorageDomainVDS method >2012-08-07 00:38:00,428 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-10) [76168fe0] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:38:00,434 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) [76168fe0] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:38:00,443 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-10) [76168fe0] FINISH, ActivateStorageDomainVDSCommand, log id: 6d0fde89 >2012-08-07 00:38:00,446 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-10) [76168fe0] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:38:00,457 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-10) [76168fe0] Command [id=e192f71d-0703-408e-be29-cca53a4831a9]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 00:38:00,510 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) [76168fe0] Checking autorecoverable storage domains done >2012-08-07 00:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Checking autorecoverable hosts >2012-08-07 00:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Autorecovering 0 hosts >2012-08-07 00:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Checking autorecoverable hosts done >2012-08-07 00:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Checking autorecoverable storage domains >2012-08-07 00:40:00,062 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Autorecovering 1 storage domains >2012-08-07 00:40:00,065 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 00:40:00,073 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-62) [1a70ab52] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:40:00,129 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-62) [1a70ab52] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 00:40:00,159 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-62) [1a70ab52] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:40:00,164 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-62) [1a70ab52] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:40 AM >2012-08-07 00:40:00,187 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [1a70ab52] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 5b5a722e >2012-08-07 00:43:00,191 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [1a70ab52] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 00:43:00,192 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [1a70ab52] FINISH, ConnectStorageServerVDSCommand, log id: 5b5a722e >2012-08-07 00:43:00,193 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [1a70ab52] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 00:43:00,224 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-62) [1a70ab52] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:43 AM >2012-08-07 00:43:00,225 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-62) [1a70ab52] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 75f33e63 >2012-08-07 00:43:00,498 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-62) [1a70ab52] Failed in ActivateStorageDomainVDS method >2012-08-07 00:43:00,499 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-62) [1a70ab52] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:43:00,501 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-62) [1a70ab52] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:43:00,509 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-62) [1a70ab52] FINISH, ActivateStorageDomainVDSCommand, log id: 75f33e63 >2012-08-07 00:43:00,512 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-62) [1a70ab52] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:43:00,523 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-62) [1a70ab52] Command [id=8bea59bc-b50f-46df-802f-1cc48aa7e024]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 00:43:00,544 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) [1a70ab52] Checking autorecoverable storage domains done >2012-08-07 00:43:07,318 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-50) [6c0929bf] DbUserCacheManager::refreshAllUserData() - entered >2012-08-07 00:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable hosts >2012-08-07 00:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Autorecovering 0 hosts >2012-08-07 00:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable hosts done >2012-08-07 00:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable storage domains >2012-08-07 00:45:00,034 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Autorecovering 1 storage domains >2012-08-07 00:45:00,036 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 00:45:00,041 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [1d98014a] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:45:00,128 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [1d98014a] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 00:45:00,154 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [1d98014a] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:45:00,158 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [1d98014a] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:45 AM >2012-08-07 00:45:00,175 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [1d98014a] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 10880b2f >2012-08-07 00:48:00,179 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [1d98014a] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 00:48:00,180 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [1d98014a] FINISH, ConnectStorageServerVDSCommand, log id: 10880b2f >2012-08-07 00:48:00,181 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [1d98014a] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 00:48:00,212 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [1d98014a] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:48 AM >2012-08-07 00:48:00,213 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-26) [1d98014a] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 294ff96 >2012-08-07 00:48:00,481 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-26) [1d98014a] Failed in ActivateStorageDomainVDS method >2012-08-07 00:48:00,482 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-26) [1d98014a] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:48:00,486 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) [1d98014a] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:48:00,494 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-26) [1d98014a] FINISH, ActivateStorageDomainVDSCommand, log id: 294ff96 >2012-08-07 00:48:00,497 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [1d98014a] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:48:00,514 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [1d98014a] Command [id=0acfa159-353f-4d0d-b729-735d07771b95]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 00:48:00,570 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [1d98014a] Checking autorecoverable storage domains done >2012-08-07 00:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [11a13a35] Checking autorecoverable hosts >2012-08-07 00:50:00,033 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [11a13a35] Autorecovering 0 hosts >2012-08-07 00:50:00,035 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [11a13a35] Checking autorecoverable hosts done >2012-08-07 00:50:00,037 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [11a13a35] Checking autorecoverable storage domains >2012-08-07 00:50:00,061 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [11a13a35] Autorecovering 1 storage domains >2012-08-07 00:50:00,064 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [11a13a35] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 00:50:00,068 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [5f27f44f] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:50:00,138 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [5f27f44f] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 00:50:00,163 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [5f27f44f] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:50:00,167 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [5f27f44f] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:50 AM >2012-08-07 00:50:00,183 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [5f27f44f] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 716eaf02 >2012-08-07 00:53:00,187 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [5f27f44f] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 00:53:00,188 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [5f27f44f] FINISH, ConnectStorageServerVDSCommand, log id: 716eaf02 >2012-08-07 00:53:00,189 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [5f27f44f] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 00:53:00,221 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [5f27f44f] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:53 AM >2012-08-07 00:53:00,222 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-7) [5f27f44f] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 5ddfc914 >2012-08-07 00:53:00,496 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-7) [5f27f44f] Failed in ActivateStorageDomainVDS method >2012-08-07 00:53:00,497 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-7) [5f27f44f] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:53:00,500 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-7) [5f27f44f] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:53:00,508 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-7) [5f27f44f] FINISH, ActivateStorageDomainVDSCommand, log id: 5ddfc914 >2012-08-07 00:53:00,511 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [5f27f44f] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:53:00,521 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [5f27f44f] Command [id=8b3e0250-5426-43f8-aa9d-7c4f0b27fcc2]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 00:53:00,542 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [5f27f44f] Checking autorecoverable storage domains done >2012-08-07 00:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [2e7f0361] Checking autorecoverable hosts >2012-08-07 00:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [2e7f0361] Autorecovering 0 hosts >2012-08-07 00:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [2e7f0361] Checking autorecoverable hosts done >2012-08-07 00:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [2e7f0361] Checking autorecoverable storage domains >2012-08-07 00:55:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [2e7f0361] Autorecovering 1 storage domains >2012-08-07 00:55:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [2e7f0361] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 00:55:00,031 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [5527193b] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:55:00,095 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [5527193b] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 00:55:00,136 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [5527193b] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 00:55:00,141 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [5527193b] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:55 AM >2012-08-07 00:55:00,163 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [5527193b] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 454ec790 >2012-08-07 00:58:00,167 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [5527193b] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 00:58:00,168 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [5527193b] FINISH, ConnectStorageServerVDSCommand, log id: 454ec790 >2012-08-07 00:58:00,173 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [5527193b] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 00:58:00,219 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [5527193b] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:58 AM >2012-08-07 00:58:00,220 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-35) [5527193b] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 1abab845 >2012-08-07 00:58:00,482 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-35) [5527193b] Failed in ActivateStorageDomainVDS method >2012-08-07 00:58:00,482 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-35) [5527193b] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:58:00,484 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-35) [5527193b] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:58:00,486 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-35) [5527193b] FINISH, ActivateStorageDomainVDSCommand, log id: 1abab845 >2012-08-07 00:58:00,490 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [5527193b] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 00:58:00,512 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [5527193b] Command [id=c782bd5e-92d9-4ef6-957f-ca0e695ac85a]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 00:58:00,559 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [5527193b] Checking autorecoverable storage domains done >2012-08-07 01:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [36d39e06] Checking autorecoverable hosts >2012-08-07 01:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [36d39e06] Autorecovering 0 hosts >2012-08-07 01:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [36d39e06] Checking autorecoverable hosts done >2012-08-07 01:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [36d39e06] Checking autorecoverable storage domains >2012-08-07 01:00:00,032 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [36d39e06] Autorecovering 1 storage domains >2012-08-07 01:00:00,035 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [36d39e06] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 01:00:00,040 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [8b2fdf0] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:00:00,115 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [8b2fdf0] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 01:00:00,145 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [8b2fdf0] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:00:00,150 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [8b2fdf0] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:00 AM >2012-08-07 01:00:00,166 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [8b2fdf0] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 2800f68f >2012-08-07 01:03:00,170 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [8b2fdf0] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 01:03:00,171 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [8b2fdf0] FINISH, ConnectStorageServerVDSCommand, log id: 2800f68f >2012-08-07 01:03:00,172 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [8b2fdf0] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 01:03:00,203 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [8b2fdf0] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:03 AM >2012-08-07 01:03:00,204 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-52) [8b2fdf0] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 3d484c27 >2012-08-07 01:03:00,483 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-52) [8b2fdf0] Failed in ActivateStorageDomainVDS method >2012-08-07 01:03:00,484 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-52) [8b2fdf0] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:03:00,486 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) [8b2fdf0] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:03:00,493 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-52) [8b2fdf0] FINISH, ActivateStorageDomainVDSCommand, log id: 3d484c27 >2012-08-07 01:03:00,496 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [8b2fdf0] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:03:00,507 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [8b2fdf0] Command [id=fa4facc0-a426-4370-a2c4-8acfc19f5956]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 01:03:00,540 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [8b2fdf0] Checking autorecoverable storage domains done >2012-08-07 01:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) [286c3454] Checking autorecoverable hosts >2012-08-07 01:05:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) [286c3454] Autorecovering 0 hosts >2012-08-07 01:05:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) [286c3454] Checking autorecoverable hosts done >2012-08-07 01:05:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) [286c3454] Checking autorecoverable storage domains >2012-08-07 01:05:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) [286c3454] Autorecovering 1 storage domains >2012-08-07 01:05:00,030 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) [286c3454] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 01:05:00,034 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-49) [84c21af] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:05:00,081 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-49) [84c21af] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 01:05:00,102 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-49) [84c21af] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:05:00,104 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-49) [84c21af] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:05 AM >2012-08-07 01:05:00,132 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [84c21af] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 241fc478 >2012-08-07 01:08:00,137 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [84c21af] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 01:08:00,138 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [84c21af] FINISH, ConnectStorageServerVDSCommand, log id: 241fc478 >2012-08-07 01:08:00,139 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [84c21af] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 01:08:00,169 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-49) [84c21af] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:08 AM >2012-08-07 01:08:00,170 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-49) [84c21af] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 792acdc2 >2012-08-07 01:08:00,437 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-49) [84c21af] Failed in ActivateStorageDomainVDS method >2012-08-07 01:08:00,438 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-49) [84c21af] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:08:00,439 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) [84c21af] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:08:00,447 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-49) [84c21af] FINISH, ActivateStorageDomainVDSCommand, log id: 792acdc2 >2012-08-07 01:08:00,450 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-49) [84c21af] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:08:00,461 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-49) [84c21af] Command [id=0fcd4c8e-4c78-4226-a9b6-b96756df23ef]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 01:08:00,498 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) [84c21af] Checking autorecoverable storage domains done >2012-08-07 01:10:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [1d98014a] Checking autorecoverable hosts >2012-08-07 01:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [1d98014a] Autorecovering 0 hosts >2012-08-07 01:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [1d98014a] Checking autorecoverable hosts done >2012-08-07 01:10:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [1d98014a] Checking autorecoverable storage domains >2012-08-07 01:10:00,045 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [1d98014a] Autorecovering 1 storage domains >2012-08-07 01:10:00,046 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [1d98014a] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 01:10:00,050 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [325bc630] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:10:00,090 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [325bc630] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 01:10:00,113 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [325bc630] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:10:00,116 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [325bc630] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:10 AM >2012-08-07 01:10:00,140 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [325bc630] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 36af34f3 >2012-08-07 01:13:00,146 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [325bc630] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 01:13:00,147 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [325bc630] FINISH, ConnectStorageServerVDSCommand, log id: 36af34f3 >2012-08-07 01:13:00,153 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [325bc630] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 01:13:00,193 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [325bc630] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:13 AM >2012-08-07 01:13:00,194 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-26) [325bc630] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 3ebd6f44 >2012-08-07 01:13:00,458 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-26) [325bc630] Failed in ActivateStorageDomainVDS method >2012-08-07 01:13:00,459 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-26) [325bc630] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:13:00,460 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) [325bc630] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:13:00,467 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-26) [325bc630] FINISH, ActivateStorageDomainVDSCommand, log id: 3ebd6f44 >2012-08-07 01:13:00,471 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [325bc630] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:13:00,487 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [325bc630] Command [id=10b57388-0ea4-44b5-9d93-fee2a96580f3]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 01:13:00,514 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [325bc630] Checking autorecoverable storage domains done >2012-08-07 01:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [362558b5] Checking autorecoverable hosts >2012-08-07 01:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [362558b5] Autorecovering 0 hosts >2012-08-07 01:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [362558b5] Checking autorecoverable hosts done >2012-08-07 01:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [362558b5] Checking autorecoverable storage domains >2012-08-07 01:15:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [362558b5] Autorecovering 1 storage domains >2012-08-07 01:15:00,029 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [362558b5] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 01:15:00,034 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-91) [5ed73bcb] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:15:00,069 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-91) [5ed73bcb] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 01:15:00,086 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-91) [5ed73bcb] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:15:00,091 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-91) [5ed73bcb] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:15 AM >2012-08-07 01:15:00,115 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [5ed73bcb] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: d75de6c >2012-08-07 01:18:00,118 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [5ed73bcb] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 01:18:00,119 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [5ed73bcb] FINISH, ConnectStorageServerVDSCommand, log id: d75de6c >2012-08-07 01:18:00,120 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [5ed73bcb] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 01:18:00,152 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-91) [5ed73bcb] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:18 AM >2012-08-07 01:18:00,153 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-91) [5ed73bcb] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 630b85a3 >2012-08-07 01:18:00,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-91) [5ed73bcb] Failed in ActivateStorageDomainVDS method >2012-08-07 01:18:00,420 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-91) [5ed73bcb] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:18:00,423 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-91) [5ed73bcb] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:18:00,431 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-91) [5ed73bcb] FINISH, ActivateStorageDomainVDSCommand, log id: 630b85a3 >2012-08-07 01:18:00,434 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-91) [5ed73bcb] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:18:00,446 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-91) [5ed73bcb] Command [id=affe42d3-2bee-4f47-ba23-6a30f35ef190]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 01:18:00,469 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [5ed73bcb] Checking autorecoverable storage domains done >2012-08-07 01:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [56fd5402] Checking autorecoverable hosts >2012-08-07 01:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [56fd5402] Autorecovering 0 hosts >2012-08-07 01:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [56fd5402] Checking autorecoverable hosts done >2012-08-07 01:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [56fd5402] Checking autorecoverable storage domains >2012-08-07 01:20:00,031 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [56fd5402] Autorecovering 1 storage domains >2012-08-07 01:20:00,031 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [56fd5402] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 01:20:00,034 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [efa832] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:20:00,079 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [efa832] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 01:20:00,100 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [efa832] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:20:00,104 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [efa832] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:20 AM >2012-08-07 01:20:00,119 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [efa832] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 1e312221 >2012-08-07 01:23:00,123 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [efa832] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 01:23:00,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [efa832] FINISH, ConnectStorageServerVDSCommand, log id: 1e312221 >2012-08-07 01:23:00,129 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [efa832] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 01:23:00,161 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [efa832] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:23 AM >2012-08-07 01:23:00,162 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-2) [efa832] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 1b9b500 >2012-08-07 01:23:00,418 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-2) [efa832] Failed in ActivateStorageDomainVDS method >2012-08-07 01:23:00,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-2) [efa832] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:23:00,424 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [efa832] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:23:00,433 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-2) [efa832] FINISH, ActivateStorageDomainVDSCommand, log id: 1b9b500 >2012-08-07 01:23:00,437 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [efa832] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:23:00,449 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [efa832] Command [id=e251240a-f160-40a3-817d-be8ebc46ad82]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 01:23:00,470 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [efa832] Checking autorecoverable storage domains done >2012-08-07 01:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [2387f4b5] Checking autorecoverable hosts >2012-08-07 01:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [2387f4b5] Autorecovering 0 hosts >2012-08-07 01:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [2387f4b5] Checking autorecoverable hosts done >2012-08-07 01:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [2387f4b5] Checking autorecoverable storage domains >2012-08-07 01:25:00,031 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [2387f4b5] Autorecovering 1 storage domains >2012-08-07 01:25:00,033 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [2387f4b5] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 01:25:00,038 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [2d82214a] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:25:00,109 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [2d82214a] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 01:25:00,126 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [2d82214a] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:25:00,130 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [2d82214a] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:25 AM >2012-08-07 01:25:00,146 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [2d82214a] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 466e4f5b >2012-08-07 01:28:00,152 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [2d82214a] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 01:28:00,153 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [2d82214a] FINISH, ConnectStorageServerVDSCommand, log id: 466e4f5b >2012-08-07 01:28:00,154 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [2d82214a] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 01:28:00,183 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [2d82214a] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:28 AM >2012-08-07 01:28:00,184 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-12) [2d82214a] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 6854f673 >2012-08-07 01:28:00,443 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-12) [2d82214a] Failed in ActivateStorageDomainVDS method >2012-08-07 01:28:00,443 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-12) [2d82214a] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:28:00,445 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) [2d82214a] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:28:00,450 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-12) [2d82214a] FINISH, ActivateStorageDomainVDSCommand, log id: 6854f673 >2012-08-07 01:28:00,454 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [2d82214a] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:28:00,465 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [2d82214a] Command [id=85b83db8-3076-4f36-93e0-89ef25ae1e92]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 01:28:00,545 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [2d82214a] Checking autorecoverable storage domains done >2012-08-07 01:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [fc9c427] Checking autorecoverable hosts >2012-08-07 01:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [fc9c427] Autorecovering 0 hosts >2012-08-07 01:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [fc9c427] Checking autorecoverable hosts done >2012-08-07 01:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [fc9c427] Checking autorecoverable storage domains >2012-08-07 01:30:00,063 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [fc9c427] Autorecovering 1 storage domains >2012-08-07 01:30:00,065 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [fc9c427] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 01:30:00,070 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [1ec8a96f] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:30:00,108 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [1ec8a96f] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 01:30:00,162 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [1ec8a96f] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:30:00,164 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [1ec8a96f] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:30 AM >2012-08-07 01:30:00,180 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [1ec8a96f] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 5b5975dc >2012-08-07 01:33:00,184 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [1ec8a96f] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 01:33:00,185 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [1ec8a96f] FINISH, ConnectStorageServerVDSCommand, log id: 5b5975dc >2012-08-07 01:33:00,185 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [1ec8a96f] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 01:33:00,215 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [1ec8a96f] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:33 AM >2012-08-07 01:33:00,216 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-27) [1ec8a96f] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 311601dd >2012-08-07 01:33:00,479 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-27) [1ec8a96f] Failed in ActivateStorageDomainVDS method >2012-08-07 01:33:00,480 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-27) [1ec8a96f] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:33:00,481 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [1ec8a96f] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:33:00,489 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-27) [1ec8a96f] FINISH, ActivateStorageDomainVDSCommand, log id: 311601dd >2012-08-07 01:33:00,492 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [1ec8a96f] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:33:00,509 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [1ec8a96f] Command [id=7fc856bf-a454-46b3-a3a6-1f3ab53b94ff]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 01:33:00,539 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [1ec8a96f] Checking autorecoverable storage domains done >2012-08-07 01:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [7e7ff5b0] Checking autorecoverable hosts >2012-08-07 01:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [7e7ff5b0] Autorecovering 0 hosts >2012-08-07 01:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [7e7ff5b0] Checking autorecoverable hosts done >2012-08-07 01:35:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [7e7ff5b0] Checking autorecoverable storage domains >2012-08-07 01:35:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [7e7ff5b0] Autorecovering 1 storage domains >2012-08-07 01:35:00,029 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [7e7ff5b0] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 01:35:00,034 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [68dc9706] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:35:00,070 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [68dc9706] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 01:35:00,082 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [68dc9706] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:35:00,087 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [68dc9706] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:35 AM >2012-08-07 01:35:00,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [68dc9706] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 77f94517 >2012-08-07 01:38:00,110 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [68dc9706] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 01:38:00,111 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [68dc9706] FINISH, ConnectStorageServerVDSCommand, log id: 77f94517 >2012-08-07 01:38:00,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [68dc9706] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 01:38:00,144 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [68dc9706] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:38 AM >2012-08-07 01:38:00,145 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-66) [68dc9706] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 90fcd71 >2012-08-07 01:38:00,397 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-66) [68dc9706] Failed in ActivateStorageDomainVDS method >2012-08-07 01:38:00,398 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-66) [68dc9706] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:38:00,402 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-66) [68dc9706] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:38:00,408 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-66) [68dc9706] FINISH, ActivateStorageDomainVDSCommand, log id: 90fcd71 >2012-08-07 01:38:00,411 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [68dc9706] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:38:00,425 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [68dc9706] Command [id=6bb3bb4e-1262-42e9-b865-67e4de8cf428]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 01:38:00,454 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [68dc9706] Checking autorecoverable storage domains done >2012-08-07 01:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Checking autorecoverable hosts >2012-08-07 01:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Autorecovering 0 hosts >2012-08-07 01:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Checking autorecoverable hosts done >2012-08-07 01:40:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Checking autorecoverable storage domains >2012-08-07 01:40:00,036 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Autorecovering 1 storage domains >2012-08-07 01:40:00,039 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 01:40:00,044 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [1932601c] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:40:00,104 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [1932601c] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 01:40:00,122 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [1932601c] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:40:00,126 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [1932601c] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:40 AM >2012-08-07 01:40:00,143 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [1932601c] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 3d09977b >2012-08-07 01:43:00,147 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [1932601c] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 01:43:00,148 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [1932601c] FINISH, ConnectStorageServerVDSCommand, log id: 3d09977b >2012-08-07 01:43:00,150 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [1932601c] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 01:43:00,181 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [1932601c] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:43 AM >2012-08-07 01:43:00,182 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-42) [1932601c] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 66928611 >2012-08-07 01:43:00,452 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-42) [1932601c] Failed in ActivateStorageDomainVDS method >2012-08-07 01:43:00,453 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-42) [1932601c] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:43:00,454 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) [1932601c] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:43:00,461 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-42) [1932601c] FINISH, ActivateStorageDomainVDSCommand, log id: 66928611 >2012-08-07 01:43:00,465 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [1932601c] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:43:00,476 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [1932601c] Command [id=4826031e-85c1-492d-8668-fbaa18a3e7f7]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 01:43:00,499 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [1932601c] Checking autorecoverable storage domains done >2012-08-07 01:43:07,321 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-14) [50a3eaa3] DbUserCacheManager::refreshAllUserData() - entered >2012-08-07 01:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [efa832] Checking autorecoverable hosts >2012-08-07 01:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [efa832] Autorecovering 0 hosts >2012-08-07 01:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [efa832] Checking autorecoverable hosts done >2012-08-07 01:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [efa832] Checking autorecoverable storage domains >2012-08-07 01:45:00,034 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [efa832] Autorecovering 1 storage domains >2012-08-07 01:45:00,037 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [efa832] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 01:45:00,042 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [6a571f09] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:45:00,078 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [6a571f09] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 01:45:00,094 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [6a571f09] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:45:00,098 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [6a571f09] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:45 AM >2012-08-07 01:45:00,117 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [6a571f09] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 35930baf >2012-08-07 01:48:00,123 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [6a571f09] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 01:48:00,124 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [6a571f09] FINISH, ConnectStorageServerVDSCommand, log id: 35930baf >2012-08-07 01:48:00,131 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [6a571f09] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 01:48:00,164 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [6a571f09] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:48 AM >2012-08-07 01:48:00,165 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-2) [6a571f09] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 5c3ad67e >2012-08-07 01:48:00,418 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-2) [6a571f09] Failed in ActivateStorageDomainVDS method >2012-08-07 01:48:00,420 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-2) [6a571f09] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:48:00,426 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [6a571f09] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:48:00,437 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-2) [6a571f09] FINISH, ActivateStorageDomainVDSCommand, log id: 5c3ad67e >2012-08-07 01:48:00,440 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [6a571f09] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:48:00,452 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [6a571f09] Command [id=4403b002-dd71-42ff-9c92-19032e6d43c0]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 01:48:00,483 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [6a571f09] Checking autorecoverable storage domains done >2012-08-07 01:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [2d82214a] Checking autorecoverable hosts >2012-08-07 01:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [2d82214a] Autorecovering 0 hosts >2012-08-07 01:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [2d82214a] Checking autorecoverable hosts done >2012-08-07 01:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [2d82214a] Checking autorecoverable storage domains >2012-08-07 01:50:00,061 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [2d82214a] Autorecovering 1 storage domains >2012-08-07 01:50:00,064 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [2d82214a] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 01:50:00,069 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [42ad975b] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:50:00,105 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [42ad975b] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 01:50:00,121 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [42ad975b] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:50:00,125 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [42ad975b] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:50 AM >2012-08-07 01:50:00,142 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [42ad975b] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 1738ddb7 >2012-08-07 01:53:00,150 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [42ad975b] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 01:53:00,153 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [42ad975b] FINISH, ConnectStorageServerVDSCommand, log id: 1738ddb7 >2012-08-07 01:53:00,157 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [42ad975b] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 01:53:00,187 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [42ad975b] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:53 AM >2012-08-07 01:53:00,188 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-12) [42ad975b] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 6eb712f6 >2012-08-07 01:53:00,442 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-12) [42ad975b] Failed in ActivateStorageDomainVDS method >2012-08-07 01:53:00,443 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-12) [42ad975b] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:53:00,445 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) [42ad975b] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:53:00,453 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-12) [42ad975b] FINISH, ActivateStorageDomainVDSCommand, log id: 6eb712f6 >2012-08-07 01:53:00,457 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [42ad975b] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:53:00,471 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [42ad975b] Command [id=d0bd09a4-9d11-4162-961f-25cae82e9645]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 01:53:00,502 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [42ad975b] Checking autorecoverable storage domains done >2012-08-07 01:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) [6b0eed98] Checking autorecoverable hosts >2012-08-07 01:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) [6b0eed98] Autorecovering 0 hosts >2012-08-07 01:55:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) [6b0eed98] Checking autorecoverable hosts done >2012-08-07 01:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) [6b0eed98] Checking autorecoverable storage domains >2012-08-07 01:55:00,061 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) [6b0eed98] Autorecovering 1 storage domains >2012-08-07 01:55:00,064 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) [6b0eed98] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 01:55:00,068 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-88) [69b363f] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:55:00,108 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-88) [69b363f] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 01:55:00,124 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-88) [69b363f] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 01:55:00,129 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-88) [69b363f] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:55 AM >2012-08-07 01:55:00,145 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [69b363f] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 49f8cfce >2012-08-07 01:58:00,151 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [69b363f] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 01:58:00,152 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [69b363f] FINISH, ConnectStorageServerVDSCommand, log id: 49f8cfce >2012-08-07 01:58:00,153 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [69b363f] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 01:58:00,180 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-88) [69b363f] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:58 AM >2012-08-07 01:58:00,181 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-88) [69b363f] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 5dbee2c0 >2012-08-07 01:58:00,435 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-88) [69b363f] Failed in ActivateStorageDomainVDS method >2012-08-07 01:58:00,436 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-88) [69b363f] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:58:00,438 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-88) [69b363f] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:58:00,447 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-88) [69b363f] FINISH, ActivateStorageDomainVDSCommand, log id: 5dbee2c0 >2012-08-07 01:58:00,455 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-88) [69b363f] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 01:58:00,471 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-88) [69b363f] Command [id=134825ed-cd41-4a58-b135-fb8bdea96031]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 01:58:00,494 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) [69b363f] Checking autorecoverable storage domains done >2012-08-07 02:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) [18da655a] Checking autorecoverable hosts >2012-08-07 02:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) [18da655a] Autorecovering 0 hosts >2012-08-07 02:00:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) [18da655a] Checking autorecoverable hosts done >2012-08-07 02:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) [18da655a] Checking autorecoverable storage domains >2012-08-07 02:00:00,052 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) [18da655a] Autorecovering 1 storage domains >2012-08-07 02:00:00,053 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) [18da655a] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 02:00:00,055 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-8) [780f5207] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:00:00,107 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-8) [780f5207] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 02:00:00,132 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-8) [780f5207] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:00:00,137 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-8) [780f5207] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:00 AM >2012-08-07 02:00:00,153 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [780f5207] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 537164fc >2012-08-07 02:03:00,158 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [780f5207] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 02:03:00,159 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [780f5207] FINISH, ConnectStorageServerVDSCommand, log id: 537164fc >2012-08-07 02:03:00,159 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [780f5207] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 02:03:00,188 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-8) [780f5207] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:03 AM >2012-08-07 02:03:00,189 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-8) [780f5207] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 3b3a878e >2012-08-07 02:03:00,459 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-8) [780f5207] Failed in ActivateStorageDomainVDS method >2012-08-07 02:03:00,460 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-8) [780f5207] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:03:00,461 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) [780f5207] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:03:00,466 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-8) [780f5207] FINISH, ActivateStorageDomainVDSCommand, log id: 3b3a878e >2012-08-07 02:03:00,470 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-8) [780f5207] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:03:00,481 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-8) [780f5207] Command [id=fb23957a-73d7-4a11-88cc-6df79fbfe16f]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 02:03:00,500 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) [780f5207] Checking autorecoverable storage domains done >2012-08-07 02:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [1932601c] Checking autorecoverable hosts >2012-08-07 02:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [1932601c] Autorecovering 0 hosts >2012-08-07 02:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [1932601c] Checking autorecoverable hosts done >2012-08-07 02:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [1932601c] Checking autorecoverable storage domains >2012-08-07 02:05:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [1932601c] Autorecovering 1 storage domains >2012-08-07 02:05:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [1932601c] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 02:05:00,033 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [405787a3] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:05:00,114 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [405787a3] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 02:05:00,132 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [405787a3] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:05:00,137 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [405787a3] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:05 AM >2012-08-07 02:05:00,153 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [405787a3] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 563bb36f >2012-08-07 02:08:00,158 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [405787a3] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 02:08:00,159 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [405787a3] FINISH, ConnectStorageServerVDSCommand, log id: 563bb36f >2012-08-07 02:08:00,160 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [405787a3] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 02:08:00,190 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [405787a3] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:08 AM >2012-08-07 02:08:00,191 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-42) [405787a3] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 4fb46415 >2012-08-07 02:08:00,443 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-42) [405787a3] Failed in ActivateStorageDomainVDS method >2012-08-07 02:08:00,444 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-42) [405787a3] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:08:00,446 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) [405787a3] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:08:00,454 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-42) [405787a3] FINISH, ActivateStorageDomainVDSCommand, log id: 4fb46415 >2012-08-07 02:08:00,457 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [405787a3] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:08:00,468 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [405787a3] Command [id=578a8d08-8759-41bd-b038-ece4659ebede]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 02:08:00,517 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [405787a3] Checking autorecoverable storage domains done >2012-08-07 02:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Checking autorecoverable hosts >2012-08-07 02:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Autorecovering 0 hosts >2012-08-07 02:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Checking autorecoverable hosts done >2012-08-07 02:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Checking autorecoverable storage domains >2012-08-07 02:10:00,031 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Autorecovering 1 storage domains >2012-08-07 02:10:00,034 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 02:10:00,039 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-1) [472e2f39] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:10:00,126 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-1) [472e2f39] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 02:10:00,160 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-1) [472e2f39] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:10:00,164 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-1) [472e2f39] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:10 AM >2012-08-07 02:10:00,184 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [472e2f39] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 2f48168c >2012-08-07 02:13:00,193 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [472e2f39] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 02:13:00,194 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [472e2f39] FINISH, ConnectStorageServerVDSCommand, log id: 2f48168c >2012-08-07 02:13:00,195 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [472e2f39] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 02:13:00,223 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-1) [472e2f39] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:13 AM >2012-08-07 02:13:00,224 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-1) [472e2f39] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 41e079a1 >2012-08-07 02:13:00,491 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-1) [472e2f39] Failed in ActivateStorageDomainVDS method >2012-08-07 02:13:00,491 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-1) [472e2f39] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:13:00,493 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-1) [472e2f39] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:13:00,498 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-1) [472e2f39] FINISH, ActivateStorageDomainVDSCommand, log id: 41e079a1 >2012-08-07 02:13:00,501 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-1) [472e2f39] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:13:00,512 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-1) [472e2f39] Command [id=9b5ceb38-f8d7-4e55-824a-005bff9453ce]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 02:13:00,532 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) [472e2f39] Checking autorecoverable storage domains done >2012-08-07 02:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) [84c21af] Checking autorecoverable hosts >2012-08-07 02:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) [84c21af] Autorecovering 0 hosts >2012-08-07 02:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) [84c21af] Checking autorecoverable hosts done >2012-08-07 02:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) [84c21af] Checking autorecoverable storage domains >2012-08-07 02:15:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) [84c21af] Autorecovering 1 storage domains >2012-08-07 02:15:00,025 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) [84c21af] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 02:15:00,034 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-49) [1b98c5ce] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:15:00,112 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-49) [1b98c5ce] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 02:15:00,137 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-49) [1b98c5ce] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:15:00,142 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-49) [1b98c5ce] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:15 AM >2012-08-07 02:15:00,159 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [1b98c5ce] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 3e1cdfa5 >2012-08-07 02:18:00,163 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [1b98c5ce] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 02:18:00,164 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [1b98c5ce] FINISH, ConnectStorageServerVDSCommand, log id: 3e1cdfa5 >2012-08-07 02:18:00,165 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [1b98c5ce] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 02:18:00,196 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-49) [1b98c5ce] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:18 AM >2012-08-07 02:18:00,197 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-49) [1b98c5ce] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 1f910090 >2012-08-07 02:18:00,453 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-49) [1b98c5ce] Failed in ActivateStorageDomainVDS method >2012-08-07 02:18:00,454 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-49) [1b98c5ce] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:18:00,456 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) [1b98c5ce] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:18:00,463 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-49) [1b98c5ce] FINISH, ActivateStorageDomainVDSCommand, log id: 1f910090 >2012-08-07 02:18:00,466 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-49) [1b98c5ce] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:18:00,476 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-49) [1b98c5ce] Command [id=e6b8d0a1-12a0-48bf-939b-e6b386a10d67]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 02:18:00,500 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) [1b98c5ce] Checking autorecoverable storage domains done >2012-08-07 02:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) [69b363f] Checking autorecoverable hosts >2012-08-07 02:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) [69b363f] Autorecovering 0 hosts >2012-08-07 02:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) [69b363f] Checking autorecoverable hosts done >2012-08-07 02:20:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) [69b363f] Checking autorecoverable storage domains >2012-08-07 02:20:00,035 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) [69b363f] Autorecovering 1 storage domains >2012-08-07 02:20:00,037 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) [69b363f] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 02:20:00,042 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-88) [7d91fb93] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:20:00,078 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-88) [7d91fb93] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 02:20:00,125 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-88) [7d91fb93] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:20:00,126 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-88) [7d91fb93] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:20 AM >2012-08-07 02:20:00,141 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [7d91fb93] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 5fd689f8 >2012-08-07 02:23:00,152 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [7d91fb93] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 02:23:00,153 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [7d91fb93] FINISH, ConnectStorageServerVDSCommand, log id: 5fd689f8 >2012-08-07 02:23:00,154 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [7d91fb93] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 02:23:00,188 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-88) [7d91fb93] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:23 AM >2012-08-07 02:23:00,189 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-88) [7d91fb93] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: ff3c87e >2012-08-07 02:23:00,445 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-88) [7d91fb93] Failed in ActivateStorageDomainVDS method >2012-08-07 02:23:00,446 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-88) [7d91fb93] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:23:00,448 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-88) [7d91fb93] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:23:00,456 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-88) [7d91fb93] FINISH, ActivateStorageDomainVDSCommand, log id: ff3c87e >2012-08-07 02:23:00,459 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-88) [7d91fb93] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:23:00,470 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-88) [7d91fb93] Command [id=e17d343c-7577-4933-b53b-545318daf25d]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 02:23:00,492 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) [7d91fb93] Checking autorecoverable storage domains done >2012-08-07 02:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable hosts >2012-08-07 02:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Autorecovering 0 hosts >2012-08-07 02:25:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable hosts done >2012-08-07 02:25:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable storage domains >2012-08-07 02:25:00,035 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Autorecovering 1 storage domains >2012-08-07 02:25:00,036 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 02:25:00,038 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-48) [1ec825c9] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:25:00,118 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-48) [1ec825c9] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 02:25:00,141 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-48) [1ec825c9] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:25:00,142 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-48) [1ec825c9] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:25 AM >2012-08-07 02:25:00,169 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [1ec825c9] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 42ed929f >2012-08-07 02:28:00,180 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [1ec825c9] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 02:28:00,181 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [1ec825c9] FINISH, ConnectStorageServerVDSCommand, log id: 42ed929f >2012-08-07 02:28:00,182 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [1ec825c9] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 02:28:00,216 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-48) [1ec825c9] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:28 AM >2012-08-07 02:28:00,218 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-48) [1ec825c9] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: b981bce >2012-08-07 02:28:00,471 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-48) [1ec825c9] Failed in ActivateStorageDomainVDS method >2012-08-07 02:28:00,472 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-48) [1ec825c9] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:28:00,475 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-48) [1ec825c9] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:28:00,482 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-48) [1ec825c9] FINISH, ActivateStorageDomainVDSCommand, log id: b981bce >2012-08-07 02:28:00,485 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-48) [1ec825c9] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:28:00,495 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-48) [1ec825c9] Command [id=14093291-28e6-4efc-88d4-3d99ae7ecbc3]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 02:28:00,542 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) [1ec825c9] Checking autorecoverable storage domains done >2012-08-07 02:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [5527193b] Checking autorecoverable hosts >2012-08-07 02:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [5527193b] Autorecovering 0 hosts >2012-08-07 02:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [5527193b] Checking autorecoverable hosts done >2012-08-07 02:30:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [5527193b] Checking autorecoverable storage domains >2012-08-07 02:30:00,032 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [5527193b] Autorecovering 1 storage domains >2012-08-07 02:30:00,035 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [5527193b] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 02:30:00,039 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [61023e04] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:30:00,077 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [61023e04] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 02:30:00,092 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [61023e04] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:30:00,097 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [61023e04] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:30 AM >2012-08-07 02:30:00,112 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [61023e04] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 5a197f5b >2012-08-07 02:33:00,116 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [61023e04] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 02:33:00,117 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [61023e04] FINISH, ConnectStorageServerVDSCommand, log id: 5a197f5b >2012-08-07 02:33:00,118 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [61023e04] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 02:33:00,148 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [61023e04] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:33 AM >2012-08-07 02:33:00,149 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-35) [61023e04] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 546c54ac >2012-08-07 02:33:00,436 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-35) [61023e04] Failed in ActivateStorageDomainVDS method >2012-08-07 02:33:00,437 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-35) [61023e04] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:33:00,440 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-35) [61023e04] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:33:00,452 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-35) [61023e04] FINISH, ActivateStorageDomainVDSCommand, log id: 546c54ac >2012-08-07 02:33:00,457 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [61023e04] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:33:00,470 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [61023e04] Command [id=bf9c82ad-9836-4ee6-a8d8-2debc0870327]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 02:33:00,514 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [61023e04] Checking autorecoverable storage domains done >2012-08-07 02:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [6bb17d09] Checking autorecoverable hosts >2012-08-07 02:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [6bb17d09] Autorecovering 0 hosts >2012-08-07 02:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [6bb17d09] Checking autorecoverable hosts done >2012-08-07 02:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [6bb17d09] Checking autorecoverable storage domains >2012-08-07 02:35:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [6bb17d09] Autorecovering 1 storage domains >2012-08-07 02:35:00,030 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [6bb17d09] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 02:35:00,034 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [18b98ac7] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:35:00,080 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [18b98ac7] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 02:35:00,118 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [18b98ac7] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:35:00,122 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [18b98ac7] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:35 AM >2012-08-07 02:35:00,148 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [18b98ac7] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 4d46d67a >2012-08-07 02:38:00,153 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [18b98ac7] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 02:38:00,155 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [18b98ac7] FINISH, ConnectStorageServerVDSCommand, log id: 4d46d67a >2012-08-07 02:38:00,157 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [18b98ac7] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 02:38:00,188 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [18b98ac7] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:38 AM >2012-08-07 02:38:00,188 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-69) [18b98ac7] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 3f532a28 >2012-08-07 02:38:00,443 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-69) [18b98ac7] Failed in ActivateStorageDomainVDS method >2012-08-07 02:38:00,444 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-69) [18b98ac7] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:38:00,445 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) [18b98ac7] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:38:00,452 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-69) [18b98ac7] FINISH, ActivateStorageDomainVDSCommand, log id: 3f532a28 >2012-08-07 02:38:00,456 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [18b98ac7] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:38:00,471 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [18b98ac7] Command [id=28135dc9-e94c-47f6-aa49-b0abe8b06deb]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 02:38:00,513 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [18b98ac7] Checking autorecoverable storage domains done >2012-08-07 02:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Checking autorecoverable hosts >2012-08-07 02:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Autorecovering 0 hosts >2012-08-07 02:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Checking autorecoverable hosts done >2012-08-07 02:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Checking autorecoverable storage domains >2012-08-07 02:40:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Autorecovering 1 storage domains >2012-08-07 02:40:00,031 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 02:40:00,035 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [4e252847] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:40:00,070 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [4e252847] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 02:40:00,136 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [4e252847] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:40:00,140 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [4e252847] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:40 AM >2012-08-07 02:40:00,208 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [4e252847] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 4d79e6ce >2012-08-07 02:43:00,214 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [4e252847] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 02:43:00,215 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [4e252847] FINISH, ConnectStorageServerVDSCommand, log id: 4d79e6ce >2012-08-07 02:43:00,216 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [4e252847] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 02:43:00,248 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [4e252847] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:43 AM >2012-08-07 02:43:00,249 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-17) [4e252847] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 165c283a >2012-08-07 02:43:00,513 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-17) [4e252847] Failed in ActivateStorageDomainVDS method >2012-08-07 02:43:00,514 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-17) [4e252847] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:43:00,515 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) [4e252847] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:43:00,519 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-17) [4e252847] FINISH, ActivateStorageDomainVDSCommand, log id: 165c283a >2012-08-07 02:43:00,522 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [4e252847] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:43:00,536 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [4e252847] Command [id=2bbe9adb-e588-4c84-83dc-f02880fb28f1]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 02:43:00,565 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [4e252847] Checking autorecoverable storage domains done >2012-08-07 02:43:07,323 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-98) DbUserCacheManager::refreshAllUserData() - entered >2012-08-07 02:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [68dc9706] Checking autorecoverable hosts >2012-08-07 02:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [68dc9706] Autorecovering 0 hosts >2012-08-07 02:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [68dc9706] Checking autorecoverable hosts done >2012-08-07 02:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [68dc9706] Checking autorecoverable storage domains >2012-08-07 02:45:00,052 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [68dc9706] Autorecovering 1 storage domains >2012-08-07 02:45:00,055 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [68dc9706] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 02:45:00,059 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [41988358] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:45:00,119 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [41988358] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 02:45:00,154 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [41988358] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:45:00,158 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [41988358] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:45 AM >2012-08-07 02:45:00,188 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [41988358] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 480e578d >2012-08-07 02:48:00,196 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [41988358] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 02:48:00,197 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [41988358] FINISH, ConnectStorageServerVDSCommand, log id: 480e578d >2012-08-07 02:48:00,200 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [41988358] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 02:48:00,230 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [41988358] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:48 AM >2012-08-07 02:48:00,231 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-66) [41988358] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 414d0a96 >2012-08-07 02:48:00,488 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-66) [41988358] Failed in ActivateStorageDomainVDS method >2012-08-07 02:48:00,489 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-66) [41988358] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:48:00,492 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-66) [41988358] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:48:00,500 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-66) [41988358] FINISH, ActivateStorageDomainVDSCommand, log id: 414d0a96 >2012-08-07 02:48:00,504 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [41988358] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:48:00,512 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [41988358] Command [id=49749128-0ef1-47b8-a612-db5e337a1568]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 02:48:00,534 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [41988358] Checking autorecoverable storage domains done >2012-08-07 02:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [10bbc57c] Checking autorecoverable hosts >2012-08-07 02:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [10bbc57c] Autorecovering 0 hosts >2012-08-07 02:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [10bbc57c] Checking autorecoverable hosts done >2012-08-07 02:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [10bbc57c] Checking autorecoverable storage domains >2012-08-07 02:50:00,034 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [10bbc57c] Autorecovering 1 storage domains >2012-08-07 02:50:00,037 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [10bbc57c] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 02:50:00,048 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [5296276f] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:50:00,107 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [5296276f] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 02:50:00,132 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [5296276f] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:50:00,133 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [5296276f] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:50 AM >2012-08-07 02:50:00,147 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [5296276f] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 551f6a8d >2012-08-07 02:53:00,150 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [5296276f] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 02:53:00,152 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [5296276f] FINISH, ConnectStorageServerVDSCommand, log id: 551f6a8d >2012-08-07 02:53:00,152 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [5296276f] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 02:53:00,183 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [5296276f] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:53 AM >2012-08-07 02:53:00,184 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-16) [5296276f] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 5a9a654c >2012-08-07 02:53:00,494 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-16) [5296276f] Failed in ActivateStorageDomainVDS method >2012-08-07 02:53:00,495 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-16) [5296276f] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:53:00,497 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [5296276f] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:53:00,504 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-16) [5296276f] FINISH, ActivateStorageDomainVDSCommand, log id: 5a9a654c >2012-08-07 02:53:00,508 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [5296276f] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:53:00,523 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [5296276f] Command [id=9cdc0232-c16f-4ac2-99fd-22d5fafcf10d]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 02:53:00,595 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [5296276f] Checking autorecoverable storage domains done >2012-08-07 02:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable hosts >2012-08-07 02:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Autorecovering 0 hosts >2012-08-07 02:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable hosts done >2012-08-07 02:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Checking autorecoverable storage domains >2012-08-07 02:55:00,037 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Autorecovering 1 storage domains >2012-08-07 02:55:00,040 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 02:55:00,044 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-65) [46fdd2e7] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:55:00,079 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-65) [46fdd2e7] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 02:55:00,104 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-65) [46fdd2e7] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 02:55:00,108 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-65) [46fdd2e7] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:55 AM >2012-08-07 02:55:00,130 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [46fdd2e7] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 6988a03b >2012-08-07 02:58:00,134 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [46fdd2e7] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 02:58:00,136 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [46fdd2e7] FINISH, ConnectStorageServerVDSCommand, log id: 6988a03b >2012-08-07 02:58:00,136 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [46fdd2e7] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 02:58:00,167 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-65) [46fdd2e7] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:58 AM >2012-08-07 02:58:00,168 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-65) [46fdd2e7] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 10ccb050 >2012-08-07 02:58:00,423 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-65) [46fdd2e7] Failed in ActivateStorageDomainVDS method >2012-08-07 02:58:00,424 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-65) [46fdd2e7] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:58:00,425 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [46fdd2e7] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:58:00,431 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-65) [46fdd2e7] FINISH, ActivateStorageDomainVDSCommand, log id: 10ccb050 >2012-08-07 02:58:00,435 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-65) [46fdd2e7] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 02:58:00,445 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-65) [46fdd2e7] Command [id=ecf35402-e5a2-41b3-b4ac-3bd56e8e5d14]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 02:58:00,485 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) [46fdd2e7] Checking autorecoverable storage domains done >2012-08-07 03:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [18b98ac7] Checking autorecoverable hosts >2012-08-07 03:00:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [18b98ac7] Autorecovering 0 hosts >2012-08-07 03:00:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [18b98ac7] Checking autorecoverable hosts done >2012-08-07 03:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [18b98ac7] Checking autorecoverable storage domains >2012-08-07 03:00:00,049 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [18b98ac7] Autorecovering 1 storage domains >2012-08-07 03:00:00,050 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [18b98ac7] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 03:00:00,053 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [2948a4ed] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:00:00,094 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [2948a4ed] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 03:00:00,115 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [2948a4ed] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:00:00,119 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [2948a4ed] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 3:00 AM >2012-08-07 03:00:00,141 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [2948a4ed] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 62a60b5e >2012-08-07 03:03:00,145 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [2948a4ed] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 03:03:00,148 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [2948a4ed] FINISH, ConnectStorageServerVDSCommand, log id: 62a60b5e >2012-08-07 03:03:00,148 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [2948a4ed] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 03:03:00,187 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [2948a4ed] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 3:03 AM >2012-08-07 03:03:00,188 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-69) [2948a4ed] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 58303ec1 >2012-08-07 03:03:00,462 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-69) [2948a4ed] Failed in ActivateStorageDomainVDS method >2012-08-07 03:03:00,463 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-69) [2948a4ed] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:03:00,468 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) [2948a4ed] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:03:00,474 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-69) [2948a4ed] FINISH, ActivateStorageDomainVDSCommand, log id: 58303ec1 >2012-08-07 03:03:00,478 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [2948a4ed] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:03:00,489 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [2948a4ed] Command [id=045c6864-8595-4ea2-a761-4b592124d2f6]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 03:03:00,511 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [2948a4ed] Checking autorecoverable storage domains done >2012-08-07 03:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) [2a2ffad5] Checking autorecoverable hosts >2012-08-07 03:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) [2a2ffad5] Autorecovering 0 hosts >2012-08-07 03:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) [2a2ffad5] Checking autorecoverable hosts done >2012-08-07 03:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) [2a2ffad5] Checking autorecoverable storage domains >2012-08-07 03:05:00,042 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) [2a2ffad5] Autorecovering 1 storage domains >2012-08-07 03:05:00,045 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) [2a2ffad5] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 03:05:00,049 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-60) [4a1aac58] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:05:00,106 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-60) [4a1aac58] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 03:05:00,149 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-60) [4a1aac58] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:05:00,153 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-60) [4a1aac58] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 3:05 AM >2012-08-07 03:05:00,169 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [4a1aac58] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 274c89b4 >2012-08-07 03:08:00,172 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [4a1aac58] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 03:08:00,173 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [4a1aac58] FINISH, ConnectStorageServerVDSCommand, log id: 274c89b4 >2012-08-07 03:08:00,174 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [4a1aac58] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 03:08:00,202 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-60) [4a1aac58] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 3:08 AM >2012-08-07 03:08:00,203 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-60) [4a1aac58] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 6343b59a >2012-08-07 03:08:00,455 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-60) [4a1aac58] Failed in ActivateStorageDomainVDS method >2012-08-07 03:08:00,456 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-60) [4a1aac58] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:08:00,458 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-60) [4a1aac58] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:08:00,468 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-60) [4a1aac58] FINISH, ActivateStorageDomainVDSCommand, log id: 6343b59a >2012-08-07 03:08:00,472 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-60) [4a1aac58] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:08:00,497 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-60) [4a1aac58] Command [id=d58c8599-3ed5-4120-87d1-93855f419cc4]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 03:08:00,534 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) [4a1aac58] Checking autorecoverable storage domains done >2012-08-07 03:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [5f27f44f] Checking autorecoverable hosts >2012-08-07 03:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [5f27f44f] Autorecovering 0 hosts >2012-08-07 03:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [5f27f44f] Checking autorecoverable hosts done >2012-08-07 03:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [5f27f44f] Checking autorecoverable storage domains >2012-08-07 03:10:00,030 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [5f27f44f] Autorecovering 1 storage domains >2012-08-07 03:10:00,032 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [5f27f44f] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 03:10:00,037 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [1855d304] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:10:00,122 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [1855d304] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 03:10:00,147 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [1855d304] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:10:00,151 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [1855d304] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 3:10 AM >2012-08-07 03:10:00,188 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [1855d304] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 47adda60 >2012-08-07 03:13:00,197 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [1855d304] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 03:13:00,201 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [1855d304] FINISH, ConnectStorageServerVDSCommand, log id: 47adda60 >2012-08-07 03:13:00,204 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [1855d304] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 03:13:00,231 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [1855d304] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 3:13 AM >2012-08-07 03:13:00,232 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-7) [1855d304] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 16883689 >2012-08-07 03:13:00,491 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-7) [1855d304] Failed in ActivateStorageDomainVDS method >2012-08-07 03:13:00,492 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-7) [1855d304] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:13:00,493 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-7) [1855d304] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:13:00,500 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-7) [1855d304] FINISH, ActivateStorageDomainVDSCommand, log id: 16883689 >2012-08-07 03:13:00,504 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [1855d304] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:13:00,520 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [1855d304] Command [id=828f3c5a-f2eb-476e-b996-9fa3d16495a9]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 03:13:00,545 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [1855d304] Checking autorecoverable storage domains done >2012-08-07 03:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [405787a3] Checking autorecoverable hosts >2012-08-07 03:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [405787a3] Autorecovering 0 hosts >2012-08-07 03:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [405787a3] Checking autorecoverable hosts done >2012-08-07 03:15:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [405787a3] Checking autorecoverable storage domains >2012-08-07 03:15:00,032 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [405787a3] Autorecovering 1 storage domains >2012-08-07 03:15:00,034 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [405787a3] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 03:15:00,038 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [362c625e] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:15:00,107 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [362c625e] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 03:15:00,124 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [362c625e] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:15:00,129 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [362c625e] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 3:15 AM >2012-08-07 03:15:00,145 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [362c625e] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 6a46f8f8 >2012-08-07 03:18:00,148 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [362c625e] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 03:18:00,149 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [362c625e] FINISH, ConnectStorageServerVDSCommand, log id: 6a46f8f8 >2012-08-07 03:18:00,150 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [362c625e] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 03:18:00,178 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [362c625e] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 3:18 AM >2012-08-07 03:18:00,179 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-42) [362c625e] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 58299576 >2012-08-07 03:18:00,429 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-42) [362c625e] Failed in ActivateStorageDomainVDS method >2012-08-07 03:18:00,430 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-42) [362c625e] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:18:00,431 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) [362c625e] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:18:00,439 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-42) [362c625e] FINISH, ActivateStorageDomainVDSCommand, log id: 58299576 >2012-08-07 03:18:00,447 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [362c625e] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:18:00,463 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [362c625e] Command [id=54d1e315-8661-43b7-a1af-c7d3465f70bf]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 03:18:00,489 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [362c625e] Checking autorecoverable storage domains done >2012-08-07 03:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Checking autorecoverable hosts >2012-08-07 03:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Autorecovering 0 hosts >2012-08-07 03:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Checking autorecoverable hosts done >2012-08-07 03:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Checking autorecoverable storage domains >2012-08-07 03:20:00,057 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Autorecovering 1 storage domains >2012-08-07 03:20:00,059 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 03:20:00,064 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-85) [3fa5778d] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:20:00,126 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-85) [3fa5778d] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 03:20:00,156 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-85) [3fa5778d] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:20:00,161 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-85) [3fa5778d] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 3:20 AM >2012-08-07 03:20:00,177 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [3fa5778d] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 51f72791 >2012-08-07 03:23:00,186 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [3fa5778d] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 03:23:00,187 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [3fa5778d] FINISH, ConnectStorageServerVDSCommand, log id: 51f72791 >2012-08-07 03:23:00,188 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [3fa5778d] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 03:23:00,221 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-85) [3fa5778d] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 3:23 AM >2012-08-07 03:23:00,222 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-85) [3fa5778d] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 51a4656b >2012-08-07 03:23:00,484 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-85) [3fa5778d] Failed in ActivateStorageDomainVDS method >2012-08-07 03:23:00,485 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-85) [3fa5778d] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:23:00,486 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) [3fa5778d] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:23:00,493 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-85) [3fa5778d] FINISH, ActivateStorageDomainVDSCommand, log id: 51a4656b >2012-08-07 03:23:00,497 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-85) [3fa5778d] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:23:00,508 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-85) [3fa5778d] Command [id=99c0d8cc-af0e-4a1e-a908-eb8a77030c97]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 03:23:00,531 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) [3fa5778d] Checking autorecoverable storage domains done >2012-08-07 03:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) [6efe2887] Checking autorecoverable hosts >2012-08-07 03:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) [6efe2887] Autorecovering 0 hosts >2012-08-07 03:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) [6efe2887] Checking autorecoverable hosts done >2012-08-07 03:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) [6efe2887] Checking autorecoverable storage domains >2012-08-07 03:25:00,043 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) [6efe2887] Autorecovering 1 storage domains >2012-08-07 03:25:00,046 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) [6efe2887] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 03:25:00,051 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [482d5e66] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:25:00,099 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [482d5e66] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 03:25:00,148 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [482d5e66] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:25:00,149 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [482d5e66] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 3:25 AM >2012-08-07 03:25:00,184 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [482d5e66] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 385c61d2 >2012-08-07 03:28:00,187 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [482d5e66] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 03:28:00,188 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [482d5e66] FINISH, ConnectStorageServerVDSCommand, log id: 385c61d2 >2012-08-07 03:28:00,189 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [482d5e66] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 03:28:00,221 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [482d5e66] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 3:28 AM >2012-08-07 03:28:00,222 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-9) [482d5e66] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 533c8291 >2012-08-07 03:28:00,475 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-9) [482d5e66] Failed in ActivateStorageDomainVDS method >2012-08-07 03:28:00,476 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-9) [482d5e66] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:28:00,480 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-9) [482d5e66] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:28:00,487 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-9) [482d5e66] FINISH, ActivateStorageDomainVDSCommand, log id: 533c8291 >2012-08-07 03:28:00,491 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [482d5e66] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:28:00,508 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [482d5e66] Command [id=f0b888b8-7a2f-40d2-b6ed-07ccc69d0747]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 03:28:00,546 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) [482d5e66] Checking autorecoverable storage domains done >2012-08-07 03:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [1f8f4fe3] Checking autorecoverable hosts >2012-08-07 03:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [1f8f4fe3] Autorecovering 0 hosts >2012-08-07 03:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [1f8f4fe3] Checking autorecoverable hosts done >2012-08-07 03:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [1f8f4fe3] Checking autorecoverable storage domains >2012-08-07 03:30:00,032 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [1f8f4fe3] Autorecovering 1 storage domains >2012-08-07 03:30:00,034 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [1f8f4fe3] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 03:30:00,039 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-5) [748df98c] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:30:00,116 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-5) [748df98c] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 03:30:00,142 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-5) [748df98c] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:30:00,147 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-5) [748df98c] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 3:30 AM >2012-08-07 03:30:00,163 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [748df98c] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 6f447438 >2012-08-07 03:33:00,167 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [748df98c] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 03:33:00,169 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [748df98c] FINISH, ConnectStorageServerVDSCommand, log id: 6f447438 >2012-08-07 03:33:00,169 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [748df98c] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 03:33:00,201 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-5) [748df98c] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 3:33 AM >2012-08-07 03:33:00,202 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-5) [748df98c] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 532ed224 >2012-08-07 03:33:00,454 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-5) [748df98c] Failed in ActivateStorageDomainVDS method >2012-08-07 03:33:00,455 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-5) [748df98c] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:33:00,459 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-5) [748df98c] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:33:00,472 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-5) [748df98c] FINISH, ActivateStorageDomainVDSCommand, log id: 532ed224 >2012-08-07 03:33:00,477 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-5) [748df98c] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:33:00,489 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-5) [748df98c] Command [id=2cbc55de-7780-4b88-b500-bf5798519116]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 03:33:00,519 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [748df98c] Checking autorecoverable storage domains done >2012-08-07 03:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [9f5a253] Checking autorecoverable hosts >2012-08-07 03:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [9f5a253] Autorecovering 0 hosts >2012-08-07 03:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [9f5a253] Checking autorecoverable hosts done >2012-08-07 03:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [9f5a253] Checking autorecoverable storage domains >2012-08-07 03:35:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [9f5a253] Autorecovering 1 storage domains >2012-08-07 03:35:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [9f5a253] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 03:35:00,033 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-73) [7d377ea1] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:35:00,071 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-73) [7d377ea1] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 03:35:00,094 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-73) [7d377ea1] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:35:00,095 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-73) [7d377ea1] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 3:35 AM >2012-08-07 03:35:00,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [7d377ea1] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 97c1bc7 >2012-08-07 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (QuartzScheduler_Worker-59) AuditLogCleanupManager::deleteAgedOutAuditLogs - entered >2012-08-07 03:38:00,114 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [7d377ea1] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 03:38:00,115 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [7d377ea1] FINISH, ConnectStorageServerVDSCommand, log id: 97c1bc7 >2012-08-07 03:38:00,119 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [7d377ea1] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 03:38:00,146 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-73) [7d377ea1] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 3:38 AM >2012-08-07 03:38:00,147 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-73) [7d377ea1] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 21871400 >2012-08-07 03:38:00,402 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-73) [7d377ea1] Failed in ActivateStorageDomainVDS method >2012-08-07 03:38:00,403 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-73) [7d377ea1] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:38:00,404 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) [7d377ea1] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:38:00,410 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-73) [7d377ea1] FINISH, ActivateStorageDomainVDSCommand, log id: 21871400 >2012-08-07 03:38:00,414 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-73) [7d377ea1] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:38:00,425 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-73) [7d377ea1] Command [id=5ca1fec1-9d5c-4377-b50b-781520dbbb4b]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 03:38:00,449 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [7d377ea1] Checking autorecoverable storage domains done >2012-08-07 03:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [393cf792] Checking autorecoverable hosts >2012-08-07 03:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [393cf792] Autorecovering 0 hosts >2012-08-07 03:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [393cf792] Checking autorecoverable hosts done >2012-08-07 03:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [393cf792] Checking autorecoverable storage domains >2012-08-07 03:40:00,051 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [393cf792] Autorecovering 1 storage domains >2012-08-07 03:40:00,053 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [393cf792] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 03:40:00,058 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [1363b26c] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:40:00,117 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [1363b26c] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 03:40:00,140 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [1363b26c] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:40:00,146 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [1363b26c] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 3:40 AM >2012-08-07 03:40:00,165 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [1363b26c] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 2cb53f14 >2012-08-07 03:43:00,169 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [1363b26c] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 03:43:00,170 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [1363b26c] FINISH, ConnectStorageServerVDSCommand, log id: 2cb53f14 >2012-08-07 03:43:00,171 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [1363b26c] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 03:43:00,199 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [1363b26c] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 3:43 AM >2012-08-07 03:43:00,200 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-29) [1363b26c] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 685514df >2012-08-07 03:43:00,468 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-29) [1363b26c] Failed in ActivateStorageDomainVDS method >2012-08-07 03:43:00,469 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-29) [1363b26c] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:43:00,470 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-29) [1363b26c] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:43:00,475 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-29) [1363b26c] FINISH, ActivateStorageDomainVDSCommand, log id: 685514df >2012-08-07 03:43:00,479 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [1363b26c] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:43:00,490 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [1363b26c] Command [id=6720226c-c877-4e95-ac0c-2b23e5674fad]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 03:43:00,512 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [1363b26c] Checking autorecoverable storage domains done >2012-08-07 03:43:07,325 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-79) [18a11d58] DbUserCacheManager::refreshAllUserData() - entered >2012-08-07 03:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) [18a11d58] Checking autorecoverable hosts >2012-08-07 03:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) [18a11d58] Autorecovering 0 hosts >2012-08-07 03:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) [18a11d58] Checking autorecoverable hosts done >2012-08-07 03:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) [18a11d58] Checking autorecoverable storage domains >2012-08-07 03:45:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) [18a11d58] Autorecovering 1 storage domains >2012-08-07 03:45:00,021 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) [18a11d58] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 03:45:00,028 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [4b41ef76] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:45:00,090 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [4b41ef76] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 03:45:00,116 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [4b41ef76] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:45:00,122 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [4b41ef76] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 3:45 AM >2012-08-07 03:45:00,144 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [4b41ef76] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 7f63aa34 >2012-08-07 03:48:00,154 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [4b41ef76] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 03:48:00,158 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [4b41ef76] FINISH, ConnectStorageServerVDSCommand, log id: 7f63aa34 >2012-08-07 03:48:00,163 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [4b41ef76] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 03:48:00,203 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [4b41ef76] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 3:48 AM >2012-08-07 03:48:00,204 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-79) [4b41ef76] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 4b0fa7c9 >2012-08-07 03:48:00,457 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-79) [4b41ef76] Failed in ActivateStorageDomainVDS method >2012-08-07 03:48:00,458 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-79) [4b41ef76] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:48:00,459 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-79) [4b41ef76] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:48:00,467 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-79) [4b41ef76] FINISH, ActivateStorageDomainVDSCommand, log id: 4b0fa7c9 >2012-08-07 03:48:00,470 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [4b41ef76] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:48:00,484 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [4b41ef76] Command [id=db49b05b-45f1-4305-b6c0-1c8150efcf6e]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 03:48:00,533 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) [4b41ef76] Checking autorecoverable storage domains done >2012-08-07 03:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [4e252847] Checking autorecoverable hosts >2012-08-07 03:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [4e252847] Autorecovering 0 hosts >2012-08-07 03:50:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [4e252847] Checking autorecoverable hosts done >2012-08-07 03:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [4e252847] Checking autorecoverable storage domains >2012-08-07 03:50:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [4e252847] Autorecovering 1 storage domains >2012-08-07 03:50:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [4e252847] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 03:50:00,022 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [7d91b0fa] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:50:00,066 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [7d91b0fa] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 03:50:00,093 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [7d91b0fa] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:50:00,098 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [7d91b0fa] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 3:50 AM >2012-08-07 03:50:00,180 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [7d91b0fa] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 4128c46a >2012-08-07 03:53:00,187 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [7d91b0fa] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 03:53:00,190 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [7d91b0fa] FINISH, ConnectStorageServerVDSCommand, log id: 4128c46a >2012-08-07 03:53:00,191 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [7d91b0fa] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 03:53:00,222 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [7d91b0fa] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 3:53 AM >2012-08-07 03:53:00,223 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-17) [7d91b0fa] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 2227617b >2012-08-07 03:53:00,484 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-17) [7d91b0fa] Failed in ActivateStorageDomainVDS method >2012-08-07 03:53:00,485 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-17) [7d91b0fa] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:53:00,487 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) [7d91b0fa] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:53:00,497 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-17) [7d91b0fa] FINISH, ActivateStorageDomainVDSCommand, log id: 2227617b >2012-08-07 03:53:00,501 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [7d91b0fa] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:53:00,510 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [7d91b0fa] Command [id=49844bc5-a324-4400-9f3d-2876a88bed1b]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 03:53:00,550 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [7d91b0fa] Checking autorecoverable storage domains done >2012-08-07 03:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [2c7a90fe] Checking autorecoverable hosts >2012-08-07 03:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [2c7a90fe] Autorecovering 0 hosts >2012-08-07 03:55:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [2c7a90fe] Checking autorecoverable hosts done >2012-08-07 03:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [2c7a90fe] Checking autorecoverable storage domains >2012-08-07 03:55:00,032 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [2c7a90fe] Autorecovering 1 storage domains >2012-08-07 03:55:00,034 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [2c7a90fe] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 03:55:00,039 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-99) [2d9be2b5] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:55:00,082 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-99) [2d9be2b5] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 03:55:00,107 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-99) [2d9be2b5] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 03:55:00,108 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-99) [2d9be2b5] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 3:55 AM >2012-08-07 03:55:00,122 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [2d9be2b5] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 7290bce9 >2012-08-07 03:58:00,125 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [2d9be2b5] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 03:58:00,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [2d9be2b5] FINISH, ConnectStorageServerVDSCommand, log id: 7290bce9 >2012-08-07 03:58:00,127 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [2d9be2b5] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 03:58:00,158 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-99) [2d9be2b5] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 3:58 AM >2012-08-07 03:58:00,159 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-99) [2d9be2b5] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 241f6821 >2012-08-07 03:58:00,411 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-99) [2d9be2b5] Failed in ActivateStorageDomainVDS method >2012-08-07 03:58:00,412 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-99) [2d9be2b5] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:58:00,416 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) [2d9be2b5] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:58:00,423 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-99) [2d9be2b5] FINISH, ActivateStorageDomainVDSCommand, log id: 241f6821 >2012-08-07 03:58:00,427 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-99) [2d9be2b5] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 03:58:00,438 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-99) [2d9be2b5] Command [id=59233f1c-71fc-4213-a2c5-f46d648d2586]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 03:58:00,462 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [2d9be2b5] Checking autorecoverable storage domains done >2012-08-07 04:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) Checking autorecoverable hosts >2012-08-07 04:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) Autorecovering 0 hosts >2012-08-07 04:00:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) Checking autorecoverable hosts done >2012-08-07 04:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) Checking autorecoverable storage domains >2012-08-07 04:00:00,039 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) Autorecovering 1 storage domains >2012-08-07 04:00:00,039 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 04:00:00,046 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-21) [43d4e7bc] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:00:00,098 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-21) [43d4e7bc] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 04:00:00,122 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-21) [43d4e7bc] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:00:00,126 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-21) [43d4e7bc] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 4:00 AM >2012-08-07 04:00:00,162 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [43d4e7bc] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 72e2a98a >2012-08-07 04:03:00,166 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [43d4e7bc] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 04:03:00,167 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [43d4e7bc] FINISH, ConnectStorageServerVDSCommand, log id: 72e2a98a >2012-08-07 04:03:00,173 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [43d4e7bc] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 04:03:00,205 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-21) [43d4e7bc] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 4:03 AM >2012-08-07 04:03:00,206 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-21) [43d4e7bc] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 445fa6 >2012-08-07 04:03:00,490 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-21) [43d4e7bc] Failed in ActivateStorageDomainVDS method >2012-08-07 04:03:00,490 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-21) [43d4e7bc] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:03:00,494 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-21) [43d4e7bc] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:03:00,500 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-21) [43d4e7bc] FINISH, ActivateStorageDomainVDSCommand, log id: 445fa6 >2012-08-07 04:03:00,503 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-21) [43d4e7bc] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:03:00,519 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-21) [43d4e7bc] Command [id=5e18caec-3fed-4357-b4ce-774105c9c445]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 04:03:00,543 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) [43d4e7bc] Checking autorecoverable storage domains done >2012-08-07 04:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [1363b26c] Checking autorecoverable hosts >2012-08-07 04:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [1363b26c] Autorecovering 0 hosts >2012-08-07 04:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [1363b26c] Checking autorecoverable hosts done >2012-08-07 04:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [1363b26c] Checking autorecoverable storage domains >2012-08-07 04:05:00,045 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [1363b26c] Autorecovering 1 storage domains >2012-08-07 04:05:00,048 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [1363b26c] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 04:05:00,052 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [626cb7bc] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:05:00,121 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [626cb7bc] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 04:05:00,143 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [626cb7bc] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:05:00,147 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [626cb7bc] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 4:05 AM >2012-08-07 04:05:00,163 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [626cb7bc] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 7acca518 >2012-08-07 04:08:00,167 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [626cb7bc] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 04:08:00,168 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [626cb7bc] FINISH, ConnectStorageServerVDSCommand, log id: 7acca518 >2012-08-07 04:08:00,169 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [626cb7bc] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 04:08:00,204 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [626cb7bc] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 4:08 AM >2012-08-07 04:08:00,205 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-29) [626cb7bc] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 691400ae >2012-08-07 04:08:00,461 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-29) [626cb7bc] Failed in ActivateStorageDomainVDS method >2012-08-07 04:08:00,462 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-29) [626cb7bc] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:08:00,463 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-29) [626cb7bc] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:08:00,471 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-29) [626cb7bc] FINISH, ActivateStorageDomainVDSCommand, log id: 691400ae >2012-08-07 04:08:00,476 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [626cb7bc] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:08:00,487 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [626cb7bc] Command [id=42f95498-703e-486c-80ec-26ef1d3e67b2]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 04:08:00,537 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [626cb7bc] Checking autorecoverable storage domains done >2012-08-07 04:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) Checking autorecoverable hosts >2012-08-07 04:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) Autorecovering 0 hosts >2012-08-07 04:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) Checking autorecoverable hosts done >2012-08-07 04:10:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) Checking autorecoverable storage domains >2012-08-07 04:10:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) Autorecovering 1 storage domains >2012-08-07 04:10:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 04:10:00,017 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-63) [5c20f626] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:10:00,073 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-63) [5c20f626] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 04:10:00,105 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-63) [5c20f626] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:10:00,109 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-63) [5c20f626] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 4:10 AM >2012-08-07 04:10:00,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [5c20f626] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 7c6f6649 >2012-08-07 04:13:00,129 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [5c20f626] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 04:13:00,130 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [5c20f626] FINISH, ConnectStorageServerVDSCommand, log id: 7c6f6649 >2012-08-07 04:13:00,136 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [5c20f626] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 04:13:00,182 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-63) [5c20f626] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 4:13 AM >2012-08-07 04:13:00,183 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-63) [5c20f626] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 15330a17 >2012-08-07 04:13:00,435 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-63) [5c20f626] Failed in ActivateStorageDomainVDS method >2012-08-07 04:13:00,436 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-63) [5c20f626] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:13:00,438 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-63) [5c20f626] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:13:00,443 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-63) [5c20f626] FINISH, ActivateStorageDomainVDSCommand, log id: 15330a17 >2012-08-07 04:13:00,447 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-63) [5c20f626] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:13:00,457 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-63) [5c20f626] Command [id=fa175964-ac04-4b3a-a8c5-deadcc5e8770]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 04:13:00,496 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) [5c20f626] Checking autorecoverable storage domains done >2012-08-07 04:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable hosts >2012-08-07 04:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Autorecovering 0 hosts >2012-08-07 04:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable hosts done >2012-08-07 04:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable storage domains >2012-08-07 04:15:00,047 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Autorecovering 1 storage domains >2012-08-07 04:15:00,049 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 04:15:00,053 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-100) [64912d58] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:15:00,117 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-100) [64912d58] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 04:15:00,156 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-100) [64912d58] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:15:00,161 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-100) [64912d58] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 4:15 AM >2012-08-07 04:15:00,177 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [64912d58] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 2921ced8 >2012-08-07 04:18:00,182 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [64912d58] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 04:18:00,183 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [64912d58] FINISH, ConnectStorageServerVDSCommand, log id: 2921ced8 >2012-08-07 04:18:00,184 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [64912d58] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 04:18:00,216 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-100) [64912d58] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 4:18 AM >2012-08-07 04:18:00,217 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-100) [64912d58] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 3f0778eb >2012-08-07 04:18:00,471 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-100) [64912d58] Failed in ActivateStorageDomainVDS method >2012-08-07 04:18:00,472 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-100) [64912d58] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:18:00,476 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-100) [64912d58] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:18:00,486 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-100) [64912d58] FINISH, ActivateStorageDomainVDSCommand, log id: 3f0778eb >2012-08-07 04:18:00,489 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-100) [64912d58] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:18:00,506 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-100) [64912d58] Command [id=39cc9717-e53c-4ffc-bbb9-575b7c17a7be]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 04:18:00,533 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) [64912d58] Checking autorecoverable storage domains done >2012-08-07 04:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) [7a91f87b] Checking autorecoverable hosts >2012-08-07 04:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) [7a91f87b] Autorecovering 0 hosts >2012-08-07 04:20:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) [7a91f87b] Checking autorecoverable hosts done >2012-08-07 04:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) [7a91f87b] Checking autorecoverable storage domains >2012-08-07 04:20:00,030 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) [7a91f87b] Autorecovering 1 storage domains >2012-08-07 04:20:00,036 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) [7a91f87b] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 04:20:00,043 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [ce49325] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:20:00,100 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [ce49325] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 04:20:00,129 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [ce49325] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:20:00,134 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [ce49325] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 4:20 AM >2012-08-07 04:20:00,155 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [ce49325] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 32490503 >2012-08-07 04:23:00,167 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [ce49325] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 04:23:00,170 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [ce49325] FINISH, ConnectStorageServerVDSCommand, log id: 32490503 >2012-08-07 04:23:00,175 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [ce49325] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 04:23:00,207 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [ce49325] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 4:23 AM >2012-08-07 04:23:00,217 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-22) [ce49325] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 796a2903 >2012-08-07 04:23:00,474 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-22) [ce49325] Failed in ActivateStorageDomainVDS method >2012-08-07 04:23:00,474 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-22) [ce49325] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:23:00,476 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) [ce49325] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:23:00,479 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-22) [ce49325] FINISH, ActivateStorageDomainVDSCommand, log id: 796a2903 >2012-08-07 04:23:00,482 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [ce49325] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:23:00,499 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [ce49325] Command [id=10af0b53-c792-484d-87fe-a7ff03b2ca8b]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 04:23:00,528 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) [ce49325] Checking autorecoverable storage domains done >2012-08-07 04:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Checking autorecoverable hosts >2012-08-07 04:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Autorecovering 0 hosts >2012-08-07 04:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Checking autorecoverable hosts done >2012-08-07 04:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Checking autorecoverable storage domains >2012-08-07 04:25:00,035 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Autorecovering 1 storage domains >2012-08-07 04:25:00,037 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 04:25:00,042 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-46) [32e1c550] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:25:00,092 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-46) [32e1c550] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 04:25:00,121 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-46) [32e1c550] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:25:00,126 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-46) [32e1c550] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 4:25 AM >2012-08-07 04:25:00,142 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [32e1c550] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: ee9d58c >2012-08-07 04:28:00,146 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [32e1c550] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 04:28:00,148 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [32e1c550] FINISH, ConnectStorageServerVDSCommand, log id: ee9d58c >2012-08-07 04:28:00,153 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [32e1c550] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 04:28:00,192 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-46) [32e1c550] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 4:28 AM >2012-08-07 04:28:00,193 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-46) [32e1c550] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 290e652f >2012-08-07 04:28:00,454 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-46) [32e1c550] Failed in ActivateStorageDomainVDS method >2012-08-07 04:28:00,455 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-46) [32e1c550] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:28:00,456 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-46) [32e1c550] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:28:00,461 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-46) [32e1c550] FINISH, ActivateStorageDomainVDSCommand, log id: 290e652f >2012-08-07 04:28:00,465 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-46) [32e1c550] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:28:00,476 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-46) [32e1c550] Command [id=2af7475e-be3b-4475-acf9-4b129598be03]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 04:28:00,526 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) [32e1c550] Checking autorecoverable storage domains done >2012-08-07 04:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [943c747] Checking autorecoverable hosts >2012-08-07 04:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [943c747] Autorecovering 0 hosts >2012-08-07 04:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [943c747] Checking autorecoverable hosts done >2012-08-07 04:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [943c747] Checking autorecoverable storage domains >2012-08-07 04:30:00,032 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [943c747] Autorecovering 1 storage domains >2012-08-07 04:30:00,034 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [943c747] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 04:30:00,045 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [3cbc20fc] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:30:00,101 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [3cbc20fc] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 04:30:00,118 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [3cbc20fc] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:30:00,123 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [3cbc20fc] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 4:30 AM >2012-08-07 04:30:00,140 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [3cbc20fc] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 3c68b208 >2012-08-07 04:33:00,144 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [3cbc20fc] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 04:33:00,145 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [3cbc20fc] FINISH, ConnectStorageServerVDSCommand, log id: 3c68b208 >2012-08-07 04:33:00,154 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [3cbc20fc] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 04:33:00,197 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [3cbc20fc] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 4:33 AM >2012-08-07 04:33:00,199 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-41) [3cbc20fc] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 385868a >2012-08-07 04:33:00,668 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-41) [3cbc20fc] Failed in ActivateStorageDomainVDS method >2012-08-07 04:33:00,669 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-41) [3cbc20fc] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:33:00,671 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) [3cbc20fc] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:33:00,678 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-41) [3cbc20fc] FINISH, ActivateStorageDomainVDSCommand, log id: 385868a >2012-08-07 04:33:00,682 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [3cbc20fc] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:33:00,701 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [3cbc20fc] Command [id=1dd6e3ed-04eb-48e9-97ca-14656cf2c514]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 04:33:00,748 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [3cbc20fc] Checking autorecoverable storage domains done >2012-08-07 04:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) [7d91fb93] Checking autorecoverable hosts >2012-08-07 04:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) [7d91fb93] Autorecovering 0 hosts >2012-08-07 04:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) [7d91fb93] Checking autorecoverable hosts done >2012-08-07 04:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) [7d91fb93] Checking autorecoverable storage domains >2012-08-07 04:35:00,039 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) [7d91fb93] Autorecovering 1 storage domains >2012-08-07 04:35:00,040 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) [7d91fb93] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 04:35:00,042 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-88) [78cde496] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:35:00,079 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-88) [78cde496] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 04:35:00,106 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-88) [78cde496] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:35:00,110 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-88) [78cde496] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 4:35 AM >2012-08-07 04:35:00,127 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [78cde496] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 3911ac0a >2012-08-07 04:38:00,130 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [78cde496] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 04:38:00,132 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [78cde496] FINISH, ConnectStorageServerVDSCommand, log id: 3911ac0a >2012-08-07 04:38:00,132 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [78cde496] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 04:38:00,164 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-88) [78cde496] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 4:38 AM >2012-08-07 04:38:00,165 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-88) [78cde496] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 4b1f10a3 >2012-08-07 04:38:00,430 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-88) [78cde496] Failed in ActivateStorageDomainVDS method >2012-08-07 04:38:00,431 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-88) [78cde496] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:38:00,432 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-88) [78cde496] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:38:00,439 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-88) [78cde496] FINISH, ActivateStorageDomainVDSCommand, log id: 4b1f10a3 >2012-08-07 04:38:00,443 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-88) [78cde496] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:38:00,453 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-88) [78cde496] Command [id=16d6046d-cb30-4ad7-a5b2-b2e49cb38f40]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 04:38:00,475 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) [78cde496] Checking autorecoverable storage domains done >2012-08-07 04:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [45d039b2] Checking autorecoverable hosts >2012-08-07 04:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [45d039b2] Autorecovering 0 hosts >2012-08-07 04:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [45d039b2] Checking autorecoverable hosts done >2012-08-07 04:40:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [45d039b2] Checking autorecoverable storage domains >2012-08-07 04:40:00,030 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [45d039b2] Autorecovering 1 storage domains >2012-08-07 04:40:00,033 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [45d039b2] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 04:40:00,038 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [7af74960] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:40:00,119 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [7af74960] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 04:40:00,143 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [7af74960] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:40:00,149 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [7af74960] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 4:40 AM >2012-08-07 04:40:00,166 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [7af74960] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 3875aab >2012-08-07 04:43:00,169 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [7af74960] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 04:43:00,170 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [7af74960] FINISH, ConnectStorageServerVDSCommand, log id: 3875aab >2012-08-07 04:43:00,171 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [7af74960] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 04:43:00,200 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [7af74960] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 4:43 AM >2012-08-07 04:43:00,201 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-37) [7af74960] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 61c16b9b >2012-08-07 04:43:00,457 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-37) [7af74960] Failed in ActivateStorageDomainVDS method >2012-08-07 04:43:00,458 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-37) [7af74960] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:43:00,459 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-37) [7af74960] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:43:00,467 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-37) [7af74960] FINISH, ActivateStorageDomainVDSCommand, log id: 61c16b9b >2012-08-07 04:43:00,470 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [7af74960] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:43:00,480 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [7af74960] Command [id=6826b899-26b9-4264-b6e7-9875bba2617d]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 04:43:00,502 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [7af74960] Checking autorecoverable storage domains done >2012-08-07 04:43:07,329 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-73) [7d377ea1] DbUserCacheManager::refreshAllUserData() - entered >2012-08-07 04:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) [76168fe0] Checking autorecoverable hosts >2012-08-07 04:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) [76168fe0] Autorecovering 0 hosts >2012-08-07 04:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) [76168fe0] Checking autorecoverable hosts done >2012-08-07 04:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) [76168fe0] Checking autorecoverable storage domains >2012-08-07 04:45:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) [76168fe0] Autorecovering 1 storage domains >2012-08-07 04:45:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) [76168fe0] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 04:45:00,031 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-10) [76f8881f] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:45:00,111 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-10) [76f8881f] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 04:45:00,150 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-10) [76f8881f] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:45:00,152 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-10) [76f8881f] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 4:45 AM >2012-08-07 04:45:00,169 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [76f8881f] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 2c74fa0a >2012-08-07 04:48:00,173 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [76f8881f] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 04:48:00,175 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [76f8881f] FINISH, ConnectStorageServerVDSCommand, log id: 2c74fa0a >2012-08-07 04:48:00,178 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [76f8881f] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 04:48:00,205 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-10) [76f8881f] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 4:48 AM >2012-08-07 04:48:00,206 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-10) [76f8881f] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 3a5f5ebe >2012-08-07 04:48:00,465 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-10) [76f8881f] Failed in ActivateStorageDomainVDS method >2012-08-07 04:48:00,466 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-10) [76f8881f] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:48:00,467 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) [76f8881f] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:48:00,474 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-10) [76f8881f] FINISH, ActivateStorageDomainVDSCommand, log id: 3a5f5ebe >2012-08-07 04:48:00,478 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-10) [76f8881f] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:48:00,488 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-10) [76f8881f] Command [id=b330f823-c48d-4467-9fa7-b15c2400dba3]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 04:48:00,509 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) [76f8881f] Checking autorecoverable storage domains done >2012-08-07 04:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [8b2fdf0] Checking autorecoverable hosts >2012-08-07 04:50:00,045 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [8b2fdf0] Autorecovering 0 hosts >2012-08-07 04:50:00,046 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [8b2fdf0] Checking autorecoverable hosts done >2012-08-07 04:50:00,046 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [8b2fdf0] Checking autorecoverable storage domains >2012-08-07 04:50:00,070 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [8b2fdf0] Autorecovering 1 storage domains >2012-08-07 04:50:00,071 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [8b2fdf0] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 04:50:00,079 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [5a58521c] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:50:00,126 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [5a58521c] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 04:50:00,145 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [5a58521c] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:50:00,146 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [5a58521c] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 4:50 AM >2012-08-07 04:50:00,168 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [5a58521c] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 9fcd4b6 >2012-08-07 04:53:00,172 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [5a58521c] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 04:53:00,173 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [5a58521c] FINISH, ConnectStorageServerVDSCommand, log id: 9fcd4b6 >2012-08-07 04:53:00,174 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [5a58521c] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 04:53:00,201 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [5a58521c] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 4:53 AM >2012-08-07 04:53:00,202 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-52) [5a58521c] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 392bb673 >2012-08-07 04:53:00,457 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-52) [5a58521c] Failed in ActivateStorageDomainVDS method >2012-08-07 04:53:00,458 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-52) [5a58521c] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:53:00,460 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) [5a58521c] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:53:00,467 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-52) [5a58521c] FINISH, ActivateStorageDomainVDSCommand, log id: 392bb673 >2012-08-07 04:53:00,471 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [5a58521c] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:53:00,482 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [5a58521c] Command [id=49126066-01c6-478f-b453-eba7632bf419]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 04:53:00,526 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [5a58521c] Checking autorecoverable storage domains done >2012-08-07 04:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [3cbc20fc] Checking autorecoverable hosts >2012-08-07 04:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [3cbc20fc] Autorecovering 0 hosts >2012-08-07 04:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [3cbc20fc] Checking autorecoverable hosts done >2012-08-07 04:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [3cbc20fc] Checking autorecoverable storage domains >2012-08-07 04:55:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [3cbc20fc] Autorecovering 1 storage domains >2012-08-07 04:55:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [3cbc20fc] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 04:55:00,030 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [3cdb2ef] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:55:00,101 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [3cdb2ef] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 04:55:00,120 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [3cdb2ef] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 04:55:00,124 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [3cdb2ef] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 4:55 AM >2012-08-07 04:55:00,140 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [3cdb2ef] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 2d3de112 >2012-08-07 04:58:00,144 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [3cdb2ef] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 04:58:00,145 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [3cdb2ef] FINISH, ConnectStorageServerVDSCommand, log id: 2d3de112 >2012-08-07 04:58:00,146 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [3cdb2ef] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 04:58:00,184 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [3cdb2ef] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 4:58 AM >2012-08-07 04:58:00,185 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-41) [3cdb2ef] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 6a1f97c9 >2012-08-07 04:58:00,609 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-41) [3cdb2ef] Failed in ActivateStorageDomainVDS method >2012-08-07 04:58:00,610 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-41) [3cdb2ef] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:58:00,613 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) [3cdb2ef] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:58:00,621 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-41) [3cdb2ef] FINISH, ActivateStorageDomainVDSCommand, log id: 6a1f97c9 >2012-08-07 04:58:00,625 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [3cdb2ef] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 04:58:00,636 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [3cdb2ef] Command [id=174c8acf-f242-4b63-a919-cc66f4cfdee1]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 04:58:00,667 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [3cdb2ef] Checking autorecoverable storage domains done >2012-08-07 05:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [7d91b0fa] Checking autorecoverable hosts >2012-08-07 05:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [7d91b0fa] Autorecovering 0 hosts >2012-08-07 05:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [7d91b0fa] Checking autorecoverable hosts done >2012-08-07 05:00:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [7d91b0fa] Checking autorecoverable storage domains >2012-08-07 05:00:00,022 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [7d91b0fa] Autorecovering 1 storage domains >2012-08-07 05:00:00,025 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [7d91b0fa] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 05:00:00,029 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [16a93396] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:00:00,167 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [16a93396] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 05:00:00,189 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [16a93396] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:00:00,190 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [16a93396] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 5:00 AM >2012-08-07 05:00:00,222 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [16a93396] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 469ed71e >2012-08-07 05:03:00,226 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [16a93396] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 05:03:00,227 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [16a93396] FINISH, ConnectStorageServerVDSCommand, log id: 469ed71e >2012-08-07 05:03:00,230 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [16a93396] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 05:03:00,277 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [16a93396] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 5:03 AM >2012-08-07 05:03:00,278 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-17) [16a93396] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 3bbb2a14 >2012-08-07 05:03:00,557 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-17) [16a93396] Failed in ActivateStorageDomainVDS method >2012-08-07 05:03:00,557 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-17) [16a93396] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:03:00,559 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) [16a93396] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:03:00,564 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-17) [16a93396] FINISH, ActivateStorageDomainVDSCommand, log id: 3bbb2a14 >2012-08-07 05:03:00,567 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [16a93396] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:03:00,577 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [16a93396] Command [id=26199040-01e0-410b-b300-fcefa94d0afc]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 05:03:00,606 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [16a93396] Checking autorecoverable storage domains done >2012-08-07 05:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Checking autorecoverable hosts >2012-08-07 05:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Autorecovering 0 hosts >2012-08-07 05:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Checking autorecoverable hosts done >2012-08-07 05:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Checking autorecoverable storage domains >2012-08-07 05:05:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Autorecovering 1 storage domains >2012-08-07 05:05:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 05:05:00,032 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-90) [1f9e7a7] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:05:00,079 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-90) [1f9e7a7] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 05:05:00,096 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-90) [1f9e7a7] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:05:00,100 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-90) [1f9e7a7] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 5:05 AM >2012-08-07 05:05:00,116 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [1f9e7a7] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 4588b6b0 >2012-08-07 05:08:00,119 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [1f9e7a7] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 05:08:00,120 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [1f9e7a7] FINISH, ConnectStorageServerVDSCommand, log id: 4588b6b0 >2012-08-07 05:08:00,121 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [1f9e7a7] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 05:08:00,154 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-90) [1f9e7a7] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 5:08 AM >2012-08-07 05:08:00,155 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-90) [1f9e7a7] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 5cb0b7da >2012-08-07 05:08:00,407 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-90) [1f9e7a7] Failed in ActivateStorageDomainVDS method >2012-08-07 05:08:00,408 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-90) [1f9e7a7] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:08:00,410 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [1f9e7a7] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:08:00,417 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-90) [1f9e7a7] FINISH, ActivateStorageDomainVDSCommand, log id: 5cb0b7da >2012-08-07 05:08:00,420 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-90) [1f9e7a7] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:08:00,431 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-90) [1f9e7a7] Command [id=d9e4202b-9550-4eaa-b534-5bf89d1dae87]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 05:08:00,450 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) [1f9e7a7] Checking autorecoverable storage domains done >2012-08-07 05:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [45a41b8f] Checking autorecoverable hosts >2012-08-07 05:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [45a41b8f] Autorecovering 0 hosts >2012-08-07 05:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [45a41b8f] Checking autorecoverable hosts done >2012-08-07 05:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [45a41b8f] Checking autorecoverable storage domains >2012-08-07 05:10:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [45a41b8f] Autorecovering 1 storage domains >2012-08-07 05:10:00,029 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [45a41b8f] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 05:10:00,033 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [6342785a] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:10:00,072 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [6342785a] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 05:10:00,097 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [6342785a] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:10:00,098 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [6342785a] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 5:10 AM >2012-08-07 05:10:00,112 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [6342785a] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 793c2d1f >2012-08-07 05:13:00,116 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [6342785a] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 05:13:00,117 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [6342785a] FINISH, ConnectStorageServerVDSCommand, log id: 793c2d1f >2012-08-07 05:13:00,118 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [6342785a] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 05:13:00,150 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [6342785a] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 5:13 AM >2012-08-07 05:13:00,151 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-55) [6342785a] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 2caaf209 >2012-08-07 05:13:00,414 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-55) [6342785a] Failed in ActivateStorageDomainVDS method >2012-08-07 05:13:00,415 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-55) [6342785a] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:13:00,417 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-55) [6342785a] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:13:00,425 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-55) [6342785a] FINISH, ActivateStorageDomainVDSCommand, log id: 2caaf209 >2012-08-07 05:13:00,428 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [6342785a] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:13:00,439 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [6342785a] Command [id=1945f937-c0dd-4c92-a2e8-1ee0f28f467c]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 05:13:00,482 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [6342785a] Checking autorecoverable storage domains done >2012-08-07 05:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [58ed0184] Checking autorecoverable hosts >2012-08-07 05:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [58ed0184] Autorecovering 0 hosts >2012-08-07 05:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [58ed0184] Checking autorecoverable hosts done >2012-08-07 05:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [58ed0184] Checking autorecoverable storage domains >2012-08-07 05:15:00,042 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [58ed0184] Autorecovering 1 storage domains >2012-08-07 05:15:00,045 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [58ed0184] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 05:15:00,050 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [6b6fdb75] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:15:00,098 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [6b6fdb75] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 05:15:00,125 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [6b6fdb75] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:15:00,130 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [6b6fdb75] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 5:15 AM >2012-08-07 05:15:00,146 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [6b6fdb75] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 43fc0c24 >2012-08-07 05:18:00,151 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [6b6fdb75] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 05:18:00,152 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [6b6fdb75] FINISH, ConnectStorageServerVDSCommand, log id: 43fc0c24 >2012-08-07 05:18:00,153 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [6b6fdb75] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 05:18:00,191 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [6b6fdb75] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 5:18 AM >2012-08-07 05:18:00,192 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-51) [6b6fdb75] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 25dd6384 >2012-08-07 05:18:00,447 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-51) [6b6fdb75] Failed in ActivateStorageDomainVDS method >2012-08-07 05:18:00,447 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-51) [6b6fdb75] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:18:00,449 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-51) [6b6fdb75] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:18:00,454 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-51) [6b6fdb75] FINISH, ActivateStorageDomainVDSCommand, log id: 25dd6384 >2012-08-07 05:18:00,457 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [6b6fdb75] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:18:00,473 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [6b6fdb75] Command [id=412b176b-9cc5-4ae5-924b-2504a418cc97]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 05:18:00,495 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [6b6fdb75] Checking autorecoverable storage domains done >2012-08-07 05:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) [4b26dace] Checking autorecoverable hosts >2012-08-07 05:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) [4b26dace] Autorecovering 0 hosts >2012-08-07 05:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) [4b26dace] Checking autorecoverable hosts done >2012-08-07 05:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) [4b26dace] Checking autorecoverable storage domains >2012-08-07 05:20:00,039 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) [4b26dace] Autorecovering 1 storage domains >2012-08-07 05:20:00,042 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) [4b26dace] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 05:20:00,046 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [5cf984b5] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:20:00,136 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [5cf984b5] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 05:20:00,201 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [5cf984b5] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:20:00,207 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [5cf984b5] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 5:20 AM >2012-08-07 05:20:00,230 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [5cf984b5] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 7c08c3aa >2012-08-07 05:23:00,236 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [5cf984b5] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 05:23:00,237 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [5cf984b5] FINISH, ConnectStorageServerVDSCommand, log id: 7c08c3aa >2012-08-07 05:23:00,239 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [5cf984b5] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 05:23:00,276 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [5cf984b5] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 5:23 AM >2012-08-07 05:23:00,278 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-23) [5cf984b5] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 186dd23e >2012-08-07 05:23:00,551 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-23) [5cf984b5] Failed in ActivateStorageDomainVDS method >2012-08-07 05:23:00,552 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-23) [5cf984b5] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:23:00,555 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) [5cf984b5] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:23:00,564 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-23) [5cf984b5] FINISH, ActivateStorageDomainVDSCommand, log id: 186dd23e >2012-08-07 05:23:00,568 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [5cf984b5] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:23:00,580 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [5cf984b5] Command [id=74fa4f0b-7d6b-47f6-8a34-cc772875aec7]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 05:23:00,635 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) [5cf984b5] Checking autorecoverable storage domains done >2012-08-07 05:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) [3e63d602] Checking autorecoverable hosts >2012-08-07 05:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) [3e63d602] Autorecovering 0 hosts >2012-08-07 05:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) [3e63d602] Checking autorecoverable hosts done >2012-08-07 05:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) [3e63d602] Checking autorecoverable storage domains >2012-08-07 05:25:00,034 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) [3e63d602] Autorecovering 1 storage domains >2012-08-07 05:25:00,036 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) [3e63d602] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 05:25:00,041 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-15) [6af2ee3a] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:25:00,080 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-15) [6af2ee3a] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 05:25:00,097 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-15) [6af2ee3a] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:25:00,101 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-15) [6af2ee3a] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 5:25 AM >2012-08-07 05:25:00,118 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [6af2ee3a] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 3f82a5ef >2012-08-07 05:28:00,121 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [6af2ee3a] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 05:28:00,122 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [6af2ee3a] FINISH, ConnectStorageServerVDSCommand, log id: 3f82a5ef >2012-08-07 05:28:00,123 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [6af2ee3a] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 05:28:00,154 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-15) [6af2ee3a] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 5:28 AM >2012-08-07 05:28:00,155 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-15) [6af2ee3a] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 4b1ba25 >2012-08-07 05:28:00,406 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-15) [6af2ee3a] Failed in ActivateStorageDomainVDS method >2012-08-07 05:28:00,406 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-15) [6af2ee3a] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:28:00,408 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-15) [6af2ee3a] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:28:00,410 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-15) [6af2ee3a] FINISH, ActivateStorageDomainVDSCommand, log id: 4b1ba25 >2012-08-07 05:28:00,414 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-15) [6af2ee3a] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:28:00,425 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-15) [6af2ee3a] Command [id=213c2c8e-2d91-4210-b11c-f19fba8cb256]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 05:28:00,477 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-15) [6af2ee3a] Checking autorecoverable storage domains done >2012-08-07 05:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [7d377ea1] Checking autorecoverable hosts >2012-08-07 05:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [7d377ea1] Autorecovering 0 hosts >2012-08-07 05:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [7d377ea1] Checking autorecoverable hosts done >2012-08-07 05:30:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [7d377ea1] Checking autorecoverable storage domains >2012-08-07 05:30:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [7d377ea1] Autorecovering 1 storage domains >2012-08-07 05:30:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [7d377ea1] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 05:30:00,031 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-73) [477c33be] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:30:00,078 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-73) [477c33be] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 05:30:00,109 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-73) [477c33be] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:30:00,110 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-73) [477c33be] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 5:30 AM >2012-08-07 05:30:00,134 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [477c33be] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 47b4e80b >2012-08-07 05:33:00,139 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [477c33be] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 05:33:00,140 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [477c33be] FINISH, ConnectStorageServerVDSCommand, log id: 47b4e80b >2012-08-07 05:33:00,141 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [477c33be] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 05:33:00,178 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-73) [477c33be] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 5:33 AM >2012-08-07 05:33:00,179 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-73) [477c33be] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 60df9bd2 >2012-08-07 05:33:00,432 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-73) [477c33be] Failed in ActivateStorageDomainVDS method >2012-08-07 05:33:00,433 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-73) [477c33be] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:33:00,435 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) [477c33be] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:33:00,443 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-73) [477c33be] FINISH, ActivateStorageDomainVDSCommand, log id: 60df9bd2 >2012-08-07 05:33:00,447 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-73) [477c33be] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:33:00,458 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-73) [477c33be] Command [id=ab3b1dd9-e786-4084-806a-0f2dea72d5ba]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 05:33:00,487 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [477c33be] Checking autorecoverable storage domains done >2012-08-07 05:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [2a3f36da] Checking autorecoverable hosts >2012-08-07 05:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [2a3f36da] Autorecovering 0 hosts >2012-08-07 05:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [2a3f36da] Checking autorecoverable hosts done >2012-08-07 05:35:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [2a3f36da] Checking autorecoverable storage domains >2012-08-07 05:35:00,062 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [2a3f36da] Autorecovering 1 storage domains >2012-08-07 05:35:00,063 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [2a3f36da] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 05:35:00,065 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-64) [317219da] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:35:00,125 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-64) [317219da] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 05:35:00,148 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-64) [317219da] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:35:00,152 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-64) [317219da] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 5:35 AM >2012-08-07 05:35:00,168 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [317219da] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 18053360 >2012-08-07 05:38:00,171 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [317219da] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 05:38:00,172 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [317219da] FINISH, ConnectStorageServerVDSCommand, log id: 18053360 >2012-08-07 05:38:00,173 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [317219da] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 05:38:00,203 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-64) [317219da] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 5:38 AM >2012-08-07 05:38:00,204 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-64) [317219da] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 25546371 >2012-08-07 05:38:00,479 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-64) [317219da] Failed in ActivateStorageDomainVDS method >2012-08-07 05:38:00,480 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-64) [317219da] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:38:00,481 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-64) [317219da] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:38:00,488 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-64) [317219da] FINISH, ActivateStorageDomainVDSCommand, log id: 25546371 >2012-08-07 05:38:00,492 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-64) [317219da] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:38:00,502 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-64) [317219da] Command [id=96e385dc-50a7-4c08-80fb-ca8db2d6b601]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 05:38:00,526 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [317219da] Checking autorecoverable storage domains done >2012-08-07 05:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [1ec8a96f] Checking autorecoverable hosts >2012-08-07 05:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [1ec8a96f] Autorecovering 0 hosts >2012-08-07 05:40:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [1ec8a96f] Checking autorecoverable hosts done >2012-08-07 05:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [1ec8a96f] Checking autorecoverable storage domains >2012-08-07 05:40:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [1ec8a96f] Autorecovering 1 storage domains >2012-08-07 05:40:00,030 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [1ec8a96f] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 05:40:00,035 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [19d9b7b3] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:40:00,067 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [19d9b7b3] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 05:40:00,082 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [19d9b7b3] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:40:00,087 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [19d9b7b3] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 5:40 AM >2012-08-07 05:40:00,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [19d9b7b3] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 330ffe54 >2012-08-07 05:43:00,106 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [19d9b7b3] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 05:43:00,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [19d9b7b3] FINISH, ConnectStorageServerVDSCommand, log id: 330ffe54 >2012-08-07 05:43:00,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [19d9b7b3] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 05:43:00,166 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [19d9b7b3] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 5:43 AM >2012-08-07 05:43:00,167 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-27) [19d9b7b3] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 60020219 >2012-08-07 05:43:00,433 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-27) [19d9b7b3] Failed in ActivateStorageDomainVDS method >2012-08-07 05:43:00,434 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-27) [19d9b7b3] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:43:00,437 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [19d9b7b3] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:43:00,482 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-27) [19d9b7b3] FINISH, ActivateStorageDomainVDSCommand, log id: 60020219 >2012-08-07 05:43:00,485 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [19d9b7b3] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:43:00,495 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [19d9b7b3] Command [id=a0863d92-b99f-453f-a0b9-d6a6b40a318f]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 05:43:00,556 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [19d9b7b3] Checking autorecoverable storage domains done >2012-08-07 05:43:07,331 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-88) [78cde496] DbUserCacheManager::refreshAllUserData() - entered >2012-08-07 05:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) [104723cd] Checking autorecoverable hosts >2012-08-07 05:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) [104723cd] Autorecovering 0 hosts >2012-08-07 05:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) [104723cd] Checking autorecoverable hosts done >2012-08-07 05:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) [104723cd] Checking autorecoverable storage domains >2012-08-07 05:45:00,033 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) [104723cd] Autorecovering 1 storage domains >2012-08-07 05:45:00,036 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) [104723cd] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 05:45:00,041 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [4bc242c7] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:45:00,080 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [4bc242c7] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 05:45:00,100 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [4bc242c7] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:45:00,105 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [4bc242c7] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 5:45 AM >2012-08-07 05:45:00,121 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [4bc242c7] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 119685ea >2012-08-07 05:48:00,125 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [4bc242c7] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 05:48:00,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [4bc242c7] FINISH, ConnectStorageServerVDSCommand, log id: 119685ea >2012-08-07 05:48:00,130 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [4bc242c7] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 05:48:00,160 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [4bc242c7] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 5:48 AM >2012-08-07 05:48:00,161 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-58) [4bc242c7] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 5eaee9a7 >2012-08-07 05:48:00,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-58) [4bc242c7] Failed in ActivateStorageDomainVDS method >2012-08-07 05:48:00,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-58) [4bc242c7] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:48:00,423 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-58) [4bc242c7] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:48:00,430 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-58) [4bc242c7] FINISH, ActivateStorageDomainVDSCommand, log id: 5eaee9a7 >2012-08-07 05:48:00,434 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [4bc242c7] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:48:00,444 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [4bc242c7] Command [id=39cc9b42-91d5-480e-b19d-670fce666fe4]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 05:48:00,508 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) [4bc242c7] Checking autorecoverable storage domains done >2012-08-07 05:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [1ee84146] Checking autorecoverable hosts >2012-08-07 05:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [1ee84146] Autorecovering 0 hosts >2012-08-07 05:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [1ee84146] Checking autorecoverable hosts done >2012-08-07 05:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [1ee84146] Checking autorecoverable storage domains >2012-08-07 05:50:00,030 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [1ee84146] Autorecovering 1 storage domains >2012-08-07 05:50:00,033 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [1ee84146] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 05:50:00,037 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [5214646f] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:50:00,094 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [5214646f] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 05:50:00,113 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [5214646f] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:50:00,117 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [5214646f] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 5:50 AM >2012-08-07 05:50:00,133 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [5214646f] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 6f7f894e >2012-08-07 05:53:00,136 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [5214646f] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 05:53:00,137 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [5214646f] FINISH, ConnectStorageServerVDSCommand, log id: 6f7f894e >2012-08-07 05:53:00,138 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [5214646f] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 05:53:00,169 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [5214646f] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 5:53 AM >2012-08-07 05:53:00,169 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-54) [5214646f] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 105c96f1 >2012-08-07 05:53:00,423 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-54) [5214646f] Failed in ActivateStorageDomainVDS method >2012-08-07 05:53:00,424 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-54) [5214646f] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:53:00,425 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-54) [5214646f] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:53:00,434 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-54) [5214646f] FINISH, ActivateStorageDomainVDSCommand, log id: 105c96f1 >2012-08-07 05:53:00,437 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [5214646f] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:53:00,455 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [5214646f] Command [id=53a55ed6-9130-4416-82e5-d813f1b40b1c]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 05:53:00,528 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [5214646f] Checking autorecoverable storage domains done >2012-08-07 05:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [6a571f09] Checking autorecoverable hosts >2012-08-07 05:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [6a571f09] Autorecovering 0 hosts >2012-08-07 05:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [6a571f09] Checking autorecoverable hosts done >2012-08-07 05:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [6a571f09] Checking autorecoverable storage domains >2012-08-07 05:55:00,046 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [6a571f09] Autorecovering 1 storage domains >2012-08-07 05:55:00,048 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [6a571f09] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 05:55:00,053 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [6d8e62e8] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:55:00,173 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [6d8e62e8] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 05:55:00,200 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [6d8e62e8] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 05:55:00,201 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [6d8e62e8] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 5:55 AM >2012-08-07 05:55:00,214 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [6d8e62e8] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 7d8d92ae >2012-08-07 05:58:00,220 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [6d8e62e8] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 05:58:00,221 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [6d8e62e8] FINISH, ConnectStorageServerVDSCommand, log id: 7d8d92ae >2012-08-07 05:58:00,222 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [6d8e62e8] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 05:58:00,251 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [6d8e62e8] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 5:58 AM >2012-08-07 05:58:00,252 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-2) [6d8e62e8] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 42b2daa >2012-08-07 05:58:00,502 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-2) [6d8e62e8] Failed in ActivateStorageDomainVDS method >2012-08-07 05:58:00,503 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-2) [6d8e62e8] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:58:00,504 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [6d8e62e8] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:58:00,511 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-2) [6d8e62e8] FINISH, ActivateStorageDomainVDSCommand, log id: 42b2daa >2012-08-07 05:58:00,514 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [6d8e62e8] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 05:58:00,524 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [6d8e62e8] Command [id=2e7c6ee5-332f-4cac-acc1-85c9c7f12f84]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 05:58:00,549 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [6d8e62e8] Checking autorecoverable storage domains done >2012-08-07 06:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) [2a21fa90] Checking autorecoverable hosts >2012-08-07 06:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) [2a21fa90] Autorecovering 0 hosts >2012-08-07 06:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) [2a21fa90] Checking autorecoverable hosts done >2012-08-07 06:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) [2a21fa90] Checking autorecoverable storage domains >2012-08-07 06:00:00,031 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) [2a21fa90] Autorecovering 1 storage domains >2012-08-07 06:00:00,033 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) [2a21fa90] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 06:00:00,038 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-31) [36f6854] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:00:00,094 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-31) [36f6854] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 06:00:00,113 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-31) [36f6854] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:00:00,117 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-31) [36f6854] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 6:00 AM >2012-08-07 06:00:00,133 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [36f6854] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 4539113a >2012-08-07 06:03:00,138 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [36f6854] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 06:03:00,139 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [36f6854] FINISH, ConnectStorageServerVDSCommand, log id: 4539113a >2012-08-07 06:03:00,139 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [36f6854] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 06:03:00,171 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-31) [36f6854] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 6:03 AM >2012-08-07 06:03:00,172 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-31) [36f6854] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 3991c7a3 >2012-08-07 06:03:00,436 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-31) [36f6854] Failed in ActivateStorageDomainVDS method >2012-08-07 06:03:00,437 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-31) [36f6854] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:03:00,439 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) [36f6854] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:03:00,447 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-31) [36f6854] FINISH, ActivateStorageDomainVDSCommand, log id: 3991c7a3 >2012-08-07 06:03:00,450 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-31) [36f6854] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:03:00,461 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-31) [36f6854] Command [id=5bb838ad-05de-4187-b1df-715367899cbe]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 06:03:00,523 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) [36f6854] Checking autorecoverable storage domains done >2012-08-07 06:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [6b6fdb75] Checking autorecoverable hosts >2012-08-07 06:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [6b6fdb75] Autorecovering 0 hosts >2012-08-07 06:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [6b6fdb75] Checking autorecoverable hosts done >2012-08-07 06:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [6b6fdb75] Checking autorecoverable storage domains >2012-08-07 06:05:00,067 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [6b6fdb75] Autorecovering 1 storage domains >2012-08-07 06:05:00,067 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [6b6fdb75] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 06:05:00,069 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [156ae689] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:05:00,132 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [156ae689] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 06:05:00,156 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [156ae689] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:05:00,160 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [156ae689] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 6:05 AM >2012-08-07 06:05:00,176 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [156ae689] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 5989de77 >2012-08-07 06:08:00,180 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [156ae689] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 06:08:00,181 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [156ae689] FINISH, ConnectStorageServerVDSCommand, log id: 5989de77 >2012-08-07 06:08:00,181 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [156ae689] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 06:08:00,211 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [156ae689] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 6:08 AM >2012-08-07 06:08:00,212 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-51) [156ae689] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 3ebfbdb7 >2012-08-07 06:08:00,464 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-51) [156ae689] Failed in ActivateStorageDomainVDS method >2012-08-07 06:08:00,465 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-51) [156ae689] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:08:00,468 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-51) [156ae689] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:08:00,473 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-51) [156ae689] FINISH, ActivateStorageDomainVDSCommand, log id: 3ebfbdb7 >2012-08-07 06:08:00,476 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [156ae689] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:08:00,486 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [156ae689] Command [id=a3ad26b4-6716-43ca-80e5-1068d21dcf2d]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 06:08:00,508 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [156ae689] Checking autorecoverable storage domains done >2012-08-07 06:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [5ed73bcb] Checking autorecoverable hosts >2012-08-07 06:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [5ed73bcb] Autorecovering 0 hosts >2012-08-07 06:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [5ed73bcb] Checking autorecoverable hosts done >2012-08-07 06:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [5ed73bcb] Checking autorecoverable storage domains >2012-08-07 06:10:00,042 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [5ed73bcb] Autorecovering 1 storage domains >2012-08-07 06:10:00,045 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [5ed73bcb] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 06:10:00,050 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-91) [7e747675] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:10:00,109 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-91) [7e747675] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 06:10:00,128 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-91) [7e747675] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:10:00,133 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-91) [7e747675] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 6:10 AM >2012-08-07 06:10:00,149 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [7e747675] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 6f5a6bd7 >2012-08-07 06:13:00,152 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [7e747675] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 06:13:00,153 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [7e747675] FINISH, ConnectStorageServerVDSCommand, log id: 6f5a6bd7 >2012-08-07 06:13:00,154 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [7e747675] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 06:13:00,194 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-91) [7e747675] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 6:13 AM >2012-08-07 06:13:00,195 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-91) [7e747675] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 667d20f8 >2012-08-07 06:13:00,466 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-91) [7e747675] Failed in ActivateStorageDomainVDS method >2012-08-07 06:13:00,467 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-91) [7e747675] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:13:00,470 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-91) [7e747675] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:13:00,477 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-91) [7e747675] FINISH, ActivateStorageDomainVDSCommand, log id: 667d20f8 >2012-08-07 06:13:00,481 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-91) [7e747675] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:13:00,492 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-91) [7e747675] Command [id=e28cb6b2-efc0-4733-b172-c69564fdd8f4]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 06:13:00,514 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [7e747675] Checking autorecoverable storage domains done >2012-08-07 06:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [5214646f] Checking autorecoverable hosts >2012-08-07 06:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [5214646f] Autorecovering 0 hosts >2012-08-07 06:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [5214646f] Checking autorecoverable hosts done >2012-08-07 06:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [5214646f] Checking autorecoverable storage domains >2012-08-07 06:15:00,053 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [5214646f] Autorecovering 1 storage domains >2012-08-07 06:15:00,058 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [5214646f] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 06:15:00,066 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [6c475743] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:15:00,116 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [6c475743] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 06:15:00,135 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [6c475743] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:15:00,145 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [6c475743] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 6:15 AM >2012-08-07 06:15:00,181 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [6c475743] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 31607dfc >2012-08-07 06:18:00,184 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [6c475743] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 06:18:00,185 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [6c475743] FINISH, ConnectStorageServerVDSCommand, log id: 31607dfc >2012-08-07 06:18:00,188 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [6c475743] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 06:18:00,219 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [6c475743] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 6:18 AM >2012-08-07 06:18:00,220 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-54) [6c475743] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 7bd083b3 >2012-08-07 06:18:00,480 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-54) [6c475743] Failed in ActivateStorageDomainVDS method >2012-08-07 06:18:00,481 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-54) [6c475743] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:18:00,482 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-54) [6c475743] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:18:00,489 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-54) [6c475743] FINISH, ActivateStorageDomainVDSCommand, log id: 7bd083b3 >2012-08-07 06:18:00,493 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [6c475743] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:18:00,503 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [6c475743] Command [id=c922da19-dc36-4806-93fc-a103b4530b3f]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 06:18:00,525 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [6c475743] Checking autorecoverable storage domains done >2012-08-07 06:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [6d8e62e8] Checking autorecoverable hosts >2012-08-07 06:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [6d8e62e8] Autorecovering 0 hosts >2012-08-07 06:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [6d8e62e8] Checking autorecoverable hosts done >2012-08-07 06:20:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [6d8e62e8] Checking autorecoverable storage domains >2012-08-07 06:20:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [6d8e62e8] Autorecovering 1 storage domains >2012-08-07 06:20:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [6d8e62e8] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 06:20:00,031 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [7a828a84] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:20:00,109 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [7a828a84] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 06:20:00,125 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [7a828a84] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:20:00,130 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [7a828a84] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 6:20 AM >2012-08-07 06:20:00,147 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [7a828a84] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 7d5be27a >2012-08-07 06:23:00,150 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [7a828a84] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 06:23:00,152 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [7a828a84] FINISH, ConnectStorageServerVDSCommand, log id: 7d5be27a >2012-08-07 06:23:00,152 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [7a828a84] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 06:23:00,184 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [7a828a84] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 6:23 AM >2012-08-07 06:23:00,185 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-2) [7a828a84] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 261ee44e >2012-08-07 06:23:00,439 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-2) [7a828a84] Failed in ActivateStorageDomainVDS method >2012-08-07 06:23:00,440 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-2) [7a828a84] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:23:00,441 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [7a828a84] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:23:00,456 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-2) [7a828a84] FINISH, ActivateStorageDomainVDSCommand, log id: 261ee44e >2012-08-07 06:23:00,460 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [7a828a84] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:23:00,483 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [7a828a84] Command [id=b6ca5aff-7a3d-443b-8e3c-7fc9ff57d7f1]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 06:23:00,504 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [7a828a84] Checking autorecoverable storage domains done >2012-08-07 06:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) [6c0929bf] Checking autorecoverable hosts >2012-08-07 06:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) [6c0929bf] Autorecovering 0 hosts >2012-08-07 06:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) [6c0929bf] Checking autorecoverable hosts done >2012-08-07 06:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) [6c0929bf] Checking autorecoverable storage domains >2012-08-07 06:25:00,049 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) [6c0929bf] Autorecovering 1 storage domains >2012-08-07 06:25:00,052 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) [6c0929bf] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 06:25:00,057 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-50) [66a7b0a3] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:25:00,138 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-50) [66a7b0a3] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 06:25:00,164 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-50) [66a7b0a3] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:25:00,174 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-50) [66a7b0a3] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 6:25 AM >2012-08-07 06:25:00,207 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [66a7b0a3] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 440c25a5 >2012-08-07 06:28:00,211 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [66a7b0a3] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 06:28:00,212 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [66a7b0a3] FINISH, ConnectStorageServerVDSCommand, log id: 440c25a5 >2012-08-07 06:28:00,218 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [66a7b0a3] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 06:28:00,245 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-50) [66a7b0a3] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 6:28 AM >2012-08-07 06:28:00,246 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-50) [66a7b0a3] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 2e469d8 >2012-08-07 06:28:00,508 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-50) [66a7b0a3] Failed in ActivateStorageDomainVDS method >2012-08-07 06:28:00,509 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-50) [66a7b0a3] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:28:00,511 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) [66a7b0a3] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:28:00,519 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-50) [66a7b0a3] FINISH, ActivateStorageDomainVDSCommand, log id: 2e469d8 >2012-08-07 06:28:00,523 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-50) [66a7b0a3] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:28:00,537 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-50) [66a7b0a3] Command [id=ffb721bf-5ec8-4494-996c-98cfa7f7136f]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 06:28:00,562 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) [66a7b0a3] Checking autorecoverable storage domains done >2012-08-07 06:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable hosts >2012-08-07 06:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Autorecovering 0 hosts >2012-08-07 06:30:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable hosts done >2012-08-07 06:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable storage domains >2012-08-07 06:30:00,047 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Autorecovering 1 storage domains >2012-08-07 06:30:00,047 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 06:30:00,050 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-61) [630d429] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:30:00,125 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-61) [630d429] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 06:30:00,159 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-61) [630d429] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:30:00,160 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-61) [630d429] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 6:30 AM >2012-08-07 06:30:00,177 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [630d429] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 5f03f279 >2012-08-07 06:33:00,181 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [630d429] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 06:33:00,182 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [630d429] FINISH, ConnectStorageServerVDSCommand, log id: 5f03f279 >2012-08-07 06:33:00,182 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [630d429] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 06:33:00,216 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-61) [630d429] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 6:33 AM >2012-08-07 06:33:00,217 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-61) [630d429] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 5958c6ed >2012-08-07 06:33:00,492 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-61) [630d429] Failed in ActivateStorageDomainVDS method >2012-08-07 06:33:00,493 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-61) [630d429] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:33:00,495 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-61) [630d429] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:33:00,503 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-61) [630d429] FINISH, ActivateStorageDomainVDSCommand, log id: 5958c6ed >2012-08-07 06:33:00,506 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-61) [630d429] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:33:00,517 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-61) [630d429] Command [id=bcbb40c2-2f07-4bfd-a600-41af658180c4]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 06:33:00,553 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) [630d429] Checking autorecoverable storage domains done >2012-08-07 06:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [2d9be2b5] Checking autorecoverable hosts >2012-08-07 06:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [2d9be2b5] Autorecovering 0 hosts >2012-08-07 06:35:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [2d9be2b5] Checking autorecoverable hosts done >2012-08-07 06:35:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [2d9be2b5] Checking autorecoverable storage domains >2012-08-07 06:35:00,025 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [2d9be2b5] Autorecovering 1 storage domains >2012-08-07 06:35:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [2d9be2b5] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 06:35:00,033 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-99) [518859ae] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:35:00,076 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-99) [518859ae] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 06:35:00,093 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-99) [518859ae] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:35:00,098 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-99) [518859ae] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 6:35 AM >2012-08-07 06:35:00,114 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [518859ae] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 2e506db5 >2012-08-07 06:38:00,118 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [518859ae] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 06:38:00,119 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [518859ae] FINISH, ConnectStorageServerVDSCommand, log id: 2e506db5 >2012-08-07 06:38:00,122 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [518859ae] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 06:38:00,152 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-99) [518859ae] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 6:38 AM >2012-08-07 06:38:00,153 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-99) [518859ae] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 37467056 >2012-08-07 06:38:00,426 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-99) [518859ae] Failed in ActivateStorageDomainVDS method >2012-08-07 06:38:00,427 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-99) [518859ae] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:38:00,431 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) [518859ae] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:38:00,442 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-99) [518859ae] FINISH, ActivateStorageDomainVDSCommand, log id: 37467056 >2012-08-07 06:38:00,445 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-99) [518859ae] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:38:00,462 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-99) [518859ae] Command [id=4a533b38-45ce-4aa8-a465-47a38d679c5d]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 06:38:00,487 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [518859ae] Checking autorecoverable storage domains done >2012-08-07 06:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) [7ab9c51e] Checking autorecoverable hosts >2012-08-07 06:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) [7ab9c51e] Autorecovering 0 hosts >2012-08-07 06:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) [7ab9c51e] Checking autorecoverable hosts done >2012-08-07 06:40:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) [7ab9c51e] Checking autorecoverable storage domains >2012-08-07 06:40:00,071 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) [7ab9c51e] Autorecovering 1 storage domains >2012-08-07 06:40:00,072 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) [7ab9c51e] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 06:40:00,079 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [1ff44d1b] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:40:00,170 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [1ff44d1b] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 06:40:00,194 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [1ff44d1b] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:40:00,195 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [1ff44d1b] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 6:40 AM >2012-08-07 06:40:00,230 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [1ff44d1b] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 5753d73f >2012-08-07 06:43:00,235 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [1ff44d1b] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 06:43:00,236 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [1ff44d1b] FINISH, ConnectStorageServerVDSCommand, log id: 5753d73f >2012-08-07 06:43:00,236 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [1ff44d1b] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 06:43:00,262 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [1ff44d1b] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 6:43 AM >2012-08-07 06:43:00,263 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-30) [1ff44d1b] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 7e9d7f69 >2012-08-07 06:43:00,568 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-30) [1ff44d1b] Failed in ActivateStorageDomainVDS method >2012-08-07 06:43:00,569 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-30) [1ff44d1b] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:43:00,570 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-30) [1ff44d1b] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:43:00,578 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-30) [1ff44d1b] FINISH, ActivateStorageDomainVDSCommand, log id: 7e9d7f69 >2012-08-07 06:43:00,582 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [1ff44d1b] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:43:00,593 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [1ff44d1b] Command [id=62b4e32c-9ce6-4c3d-9b8b-d4619ab7adb0]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 06:43:00,650 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) [1ff44d1b] Checking autorecoverable storage domains done >2012-08-07 06:43:07,336 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-47) [c0f2967] DbUserCacheManager::refreshAllUserData() - entered >2012-08-07 06:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) [32e1c550] Checking autorecoverable hosts >2012-08-07 06:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) [32e1c550] Autorecovering 0 hosts >2012-08-07 06:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) [32e1c550] Checking autorecoverable hosts done >2012-08-07 06:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) [32e1c550] Checking autorecoverable storage domains >2012-08-07 06:45:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) [32e1c550] Autorecovering 1 storage domains >2012-08-07 06:45:00,029 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) [32e1c550] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 06:45:00,033 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-46) [1406e586] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:45:00,072 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-46) [1406e586] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 06:45:00,088 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-46) [1406e586] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:45:00,093 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-46) [1406e586] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 6:45 AM >2012-08-07 06:45:00,116 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [1406e586] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 1c34f971 >2012-08-07 06:48:00,120 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [1406e586] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 06:48:00,121 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [1406e586] FINISH, ConnectStorageServerVDSCommand, log id: 1c34f971 >2012-08-07 06:48:00,122 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [1406e586] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 06:48:00,151 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-46) [1406e586] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 6:48 AM >2012-08-07 06:48:00,152 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-46) [1406e586] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 3aa74b76 >2012-08-07 06:48:00,406 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-46) [1406e586] Failed in ActivateStorageDomainVDS method >2012-08-07 06:48:00,406 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-46) [1406e586] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:48:00,408 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-46) [1406e586] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:48:00,414 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-46) [1406e586] FINISH, ActivateStorageDomainVDSCommand, log id: 3aa74b76 >2012-08-07 06:48:00,418 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-46) [1406e586] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:48:00,428 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-46) [1406e586] Command [id=5f132df6-613b-434b-9361-1a5f1e953423]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 06:48:00,471 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) [1406e586] Checking autorecoverable storage domains done >2012-08-07 06:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [19d9b7b3] Checking autorecoverable hosts >2012-08-07 06:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [19d9b7b3] Autorecovering 0 hosts >2012-08-07 06:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [19d9b7b3] Checking autorecoverable hosts done >2012-08-07 06:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [19d9b7b3] Checking autorecoverable storage domains >2012-08-07 06:50:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [19d9b7b3] Autorecovering 1 storage domains >2012-08-07 06:50:00,031 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [19d9b7b3] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 06:50:00,036 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [2a333717] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:50:00,116 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [2a333717] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 06:50:00,162 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [2a333717] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:50:00,167 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [2a333717] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 6:50 AM >2012-08-07 06:50:00,190 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [2a333717] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 165d2d87 >2012-08-07 06:53:00,194 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [2a333717] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 06:53:00,195 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [2a333717] FINISH, ConnectStorageServerVDSCommand, log id: 165d2d87 >2012-08-07 06:53:00,195 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [2a333717] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 06:53:00,229 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [2a333717] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 6:53 AM >2012-08-07 06:53:00,230 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-27) [2a333717] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 69c7d4cb >2012-08-07 06:53:00,484 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-27) [2a333717] Failed in ActivateStorageDomainVDS method >2012-08-07 06:53:00,484 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-27) [2a333717] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:53:00,486 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [2a333717] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:53:00,518 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-27) [2a333717] FINISH, ActivateStorageDomainVDSCommand, log id: 69c7d4cb >2012-08-07 06:53:00,521 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [2a333717] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:53:00,535 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-27) [2a333717] Command [id=67043c68-b747-486a-bb16-9d28e0306399]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 06:53:00,563 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [2a333717] Checking autorecoverable storage domains done >2012-08-07 06:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [134b55bd] Checking autorecoverable hosts >2012-08-07 06:55:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [134b55bd] Autorecovering 0 hosts >2012-08-07 06:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [134b55bd] Checking autorecoverable hosts done >2012-08-07 06:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [134b55bd] Checking autorecoverable storage domains >2012-08-07 06:55:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [134b55bd] Autorecovering 1 storage domains >2012-08-07 06:55:00,029 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [134b55bd] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 06:55:00,033 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [58f6af40] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:55:00,069 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [58f6af40] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 06:55:00,083 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [58f6af40] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 06:55:00,087 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [58f6af40] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 6:55 AM >2012-08-07 06:55:00,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [58f6af40] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 4c912704 >2012-08-07 06:58:00,108 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [58f6af40] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 06:58:00,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [58f6af40] FINISH, ConnectStorageServerVDSCommand, log id: 4c912704 >2012-08-07 06:58:00,117 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [58f6af40] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 06:58:00,156 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [58f6af40] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 6:58 AM >2012-08-07 06:58:00,157 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-93) [58f6af40] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 137cd9c4 >2012-08-07 06:58:00,409 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-93) [58f6af40] Failed in ActivateStorageDomainVDS method >2012-08-07 06:58:00,410 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-93) [58f6af40] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:58:00,412 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) [58f6af40] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:58:00,420 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-93) [58f6af40] FINISH, ActivateStorageDomainVDSCommand, log id: 137cd9c4 >2012-08-07 06:58:00,423 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [58f6af40] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 06:58:00,438 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [58f6af40] Command [id=dba58326-63b8-485e-b955-9ca58e756d21]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 06:58:00,459 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [58f6af40] Checking autorecoverable storage domains done >2012-08-07 07:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [7af74960] Checking autorecoverable hosts >2012-08-07 07:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [7af74960] Autorecovering 0 hosts >2012-08-07 07:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [7af74960] Checking autorecoverable hosts done >2012-08-07 07:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [7af74960] Checking autorecoverable storage domains >2012-08-07 07:00:00,035 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [7af74960] Autorecovering 1 storage domains >2012-08-07 07:00:00,037 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [7af74960] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 07:00:00,044 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [4c220a92] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:00:00,085 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [4c220a92] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 07:00:00,131 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [4c220a92] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:00:00,135 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [4c220a92] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 7:00 AM >2012-08-07 07:00:00,152 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [4c220a92] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 14dcbf4d >2012-08-07 07:03:00,155 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [4c220a92] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 07:03:00,157 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [4c220a92] FINISH, ConnectStorageServerVDSCommand, log id: 14dcbf4d >2012-08-07 07:03:00,158 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [4c220a92] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 07:03:00,187 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [4c220a92] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 7:03 AM >2012-08-07 07:03:00,188 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-37) [4c220a92] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 6d33c7d3 >2012-08-07 07:03:00,466 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-37) [4c220a92] Failed in ActivateStorageDomainVDS method >2012-08-07 07:03:00,467 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-37) [4c220a92] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:03:00,468 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-37) [4c220a92] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:03:00,476 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-37) [4c220a92] FINISH, ActivateStorageDomainVDSCommand, log id: 6d33c7d3 >2012-08-07 07:03:00,480 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [4c220a92] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:03:00,491 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [4c220a92] Command [id=d3cbaee5-a608-42db-b7c1-38f3a99e95bb]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 07:03:00,512 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [4c220a92] Checking autorecoverable storage domains done >2012-08-07 07:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Checking autorecoverable hosts >2012-08-07 07:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Autorecovering 0 hosts >2012-08-07 07:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Checking autorecoverable hosts done >2012-08-07 07:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Checking autorecoverable storage domains >2012-08-07 07:05:00,031 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Autorecovering 1 storage domains >2012-08-07 07:05:00,033 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 07:05:00,039 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-94) [7bf5c72f] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:05:00,089 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-94) [7bf5c72f] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 07:05:00,111 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-94) [7bf5c72f] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:05:00,113 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-94) [7bf5c72f] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 7:05 AM >2012-08-07 07:05:00,137 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [7bf5c72f] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 373c663b >2012-08-07 07:08:00,146 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [7bf5c72f] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 07:08:00,147 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [7bf5c72f] FINISH, ConnectStorageServerVDSCommand, log id: 373c663b >2012-08-07 07:08:00,150 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [7bf5c72f] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 07:08:00,180 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-94) [7bf5c72f] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 7:08 AM >2012-08-07 07:08:00,181 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-94) [7bf5c72f] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 10cd40b4 >2012-08-07 07:08:00,461 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-94) [7bf5c72f] Failed in ActivateStorageDomainVDS method >2012-08-07 07:08:00,462 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-94) [7bf5c72f] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:08:00,463 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-94) [7bf5c72f] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:08:00,469 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-94) [7bf5c72f] FINISH, ActivateStorageDomainVDSCommand, log id: 10cd40b4 >2012-08-07 07:08:00,473 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-94) [7bf5c72f] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:08:00,486 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-94) [7bf5c72f] Command [id=95dbd5c9-0c1a-4db7-b044-a629fcdd5241]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 07:08:00,522 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) [7bf5c72f] Checking autorecoverable storage domains done >2012-08-07 07:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) Checking autorecoverable hosts >2012-08-07 07:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) Autorecovering 0 hosts >2012-08-07 07:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) Checking autorecoverable hosts done >2012-08-07 07:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) Checking autorecoverable storage domains >2012-08-07 07:10:00,025 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) Autorecovering 1 storage domains >2012-08-07 07:10:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 07:10:00,031 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-59) [f09a8f8] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:10:00,074 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-59) [f09a8f8] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 07:10:00,092 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-59) [f09a8f8] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:10:00,096 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-59) [f09a8f8] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 7:10 AM >2012-08-07 07:10:00,341 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [f09a8f8] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 5e1759a9 >2012-08-07 07:13:00,346 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [f09a8f8] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 07:13:00,347 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [f09a8f8] FINISH, ConnectStorageServerVDSCommand, log id: 5e1759a9 >2012-08-07 07:13:00,353 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [f09a8f8] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 07:13:00,396 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-59) [f09a8f8] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 7:13 AM >2012-08-07 07:13:00,399 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-59) [f09a8f8] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 565d389c >2012-08-07 07:13:00,662 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-59) [f09a8f8] Failed in ActivateStorageDomainVDS method >2012-08-07 07:13:00,663 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-59) [f09a8f8] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:13:00,664 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-59) [f09a8f8] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:13:00,669 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-59) [f09a8f8] FINISH, ActivateStorageDomainVDSCommand, log id: 565d389c >2012-08-07 07:13:00,673 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-59) [f09a8f8] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:13:00,684 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-59) [f09a8f8] Command [id=b0f04423-c02b-4960-b5cc-38a10ca482d6]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 07:13:00,718 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) [f09a8f8] Checking autorecoverable storage domains done >2012-08-07 07:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) [5cf984b5] Checking autorecoverable hosts >2012-08-07 07:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) [5cf984b5] Autorecovering 0 hosts >2012-08-07 07:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) [5cf984b5] Checking autorecoverable hosts done >2012-08-07 07:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) [5cf984b5] Checking autorecoverable storage domains >2012-08-07 07:15:00,021 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) [5cf984b5] Autorecovering 1 storage domains >2012-08-07 07:15:00,021 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) [5cf984b5] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 07:15:00,026 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [6154c877] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:15:00,133 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [6154c877] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 07:15:00,151 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [6154c877] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:15:00,155 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [6154c877] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 7:15 AM >2012-08-07 07:15:00,171 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [6154c877] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 40c6ee5a >2012-08-07 07:18:00,174 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [6154c877] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 07:18:00,176 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [6154c877] FINISH, ConnectStorageServerVDSCommand, log id: 40c6ee5a >2012-08-07 07:18:00,176 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [6154c877] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 07:18:00,208 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [6154c877] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 7:18 AM >2012-08-07 07:18:00,209 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-23) [6154c877] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 2420d8c3 >2012-08-07 07:18:00,461 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-23) [6154c877] Failed in ActivateStorageDomainVDS method >2012-08-07 07:18:00,462 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-23) [6154c877] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:18:00,463 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) [6154c877] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:18:00,470 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-23) [6154c877] FINISH, ActivateStorageDomainVDSCommand, log id: 2420d8c3 >2012-08-07 07:18:00,473 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [6154c877] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:18:00,484 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-23) [6154c877] Command [id=24e5f725-2112-427c-a692-a03aca8a0978]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 07:18:00,507 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) [6154c877] Checking autorecoverable storage domains done >2012-08-07 07:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) [68a3eeac] Checking autorecoverable hosts >2012-08-07 07:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) [68a3eeac] Autorecovering 0 hosts >2012-08-07 07:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) [68a3eeac] Checking autorecoverable hosts done >2012-08-07 07:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) [68a3eeac] Checking autorecoverable storage domains >2012-08-07 07:20:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) [68a3eeac] Autorecovering 1 storage domains >2012-08-07 07:20:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) [68a3eeac] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 07:20:00,037 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-71) [6eb854d] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:20:00,082 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-71) [6eb854d] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 07:20:00,099 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-71) [6eb854d] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:20:00,103 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-71) [6eb854d] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 7:20 AM >2012-08-07 07:20:00,122 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [6eb854d] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 5395f187 >2012-08-07 07:23:00,126 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [6eb854d] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 07:23:00,127 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [6eb854d] FINISH, ConnectStorageServerVDSCommand, log id: 5395f187 >2012-08-07 07:23:00,128 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [6eb854d] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 07:23:00,156 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-71) [6eb854d] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 7:23 AM >2012-08-07 07:23:00,157 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-71) [6eb854d] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 3041b51b >2012-08-07 07:23:00,444 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-71) [6eb854d] Failed in ActivateStorageDomainVDS method >2012-08-07 07:23:00,445 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-71) [6eb854d] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:23:00,446 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-71) [6eb854d] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:23:00,454 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-71) [6eb854d] FINISH, ActivateStorageDomainVDSCommand, log id: 3041b51b >2012-08-07 07:23:00,457 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-71) [6eb854d] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:23:00,468 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-71) [6eb854d] Command [id=636b7db1-7f4a-4df8-8342-f4524eb6292f]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 07:23:00,487 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) [6eb854d] Checking autorecoverable storage domains done >2012-08-07 07:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [1855d304] Checking autorecoverable hosts >2012-08-07 07:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [1855d304] Autorecovering 0 hosts >2012-08-07 07:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [1855d304] Checking autorecoverable hosts done >2012-08-07 07:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [1855d304] Checking autorecoverable storage domains >2012-08-07 07:25:00,053 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [1855d304] Autorecovering 1 storage domains >2012-08-07 07:25:00,055 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [1855d304] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 07:25:00,059 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [5036be57] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:25:00,120 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [5036be57] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 07:25:00,169 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [5036be57] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:25:00,174 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [5036be57] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 7:25 AM >2012-08-07 07:25:00,190 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [5036be57] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 6b709865 >2012-08-07 07:28:00,193 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [5036be57] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 07:28:00,194 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [5036be57] FINISH, ConnectStorageServerVDSCommand, log id: 6b709865 >2012-08-07 07:28:00,195 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [5036be57] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 07:28:00,224 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [5036be57] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 7:28 AM >2012-08-07 07:28:00,225 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-7) [5036be57] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 725c8327 >2012-08-07 07:28:00,477 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-7) [5036be57] Failed in ActivateStorageDomainVDS method >2012-08-07 07:28:00,478 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-7) [5036be57] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:28:00,481 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-7) [5036be57] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:28:00,489 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-7) [5036be57] FINISH, ActivateStorageDomainVDSCommand, log id: 725c8327 >2012-08-07 07:28:00,492 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [5036be57] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:28:00,502 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-7) [5036be57] Command [id=3b6ccea7-469c-43c5-813e-b547b0a647a0]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 07:28:00,550 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [5036be57] Checking autorecoverable storage domains done >2012-08-07 07:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [6325a812] Checking autorecoverable hosts >2012-08-07 07:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [6325a812] Autorecovering 0 hosts >2012-08-07 07:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [6325a812] Checking autorecoverable hosts done >2012-08-07 07:30:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [6325a812] Checking autorecoverable storage domains >2012-08-07 07:30:00,056 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [6325a812] Autorecovering 1 storage domains >2012-08-07 07:30:00,059 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [6325a812] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 07:30:00,064 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [76a53ad2] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:30:00,115 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [76a53ad2] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 07:30:00,184 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [76a53ad2] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:30:00,189 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [76a53ad2] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 7:30 AM >2012-08-07 07:30:00,207 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [76a53ad2] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 2abe649a >2012-08-07 07:33:00,211 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [76a53ad2] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 07:33:00,212 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [76a53ad2] FINISH, ConnectStorageServerVDSCommand, log id: 2abe649a >2012-08-07 07:33:00,213 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [76a53ad2] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 07:33:00,255 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [76a53ad2] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 7:33 AM >2012-08-07 07:33:00,256 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-72) [76a53ad2] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 57b673d3 >2012-08-07 07:33:00,582 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-72) [76a53ad2] Failed in ActivateStorageDomainVDS method >2012-08-07 07:33:00,583 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-72) [76a53ad2] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:33:00,586 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-72) [76a53ad2] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:33:00,599 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-72) [76a53ad2] FINISH, ActivateStorageDomainVDSCommand, log id: 57b673d3 >2012-08-07 07:33:00,605 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [76a53ad2] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:33:00,625 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [76a53ad2] Command [id=e72d3157-0d3e-4d7b-9260-15fbdc722ad7]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 07:33:00,683 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [76a53ad2] Checking autorecoverable storage domains done >2012-08-07 07:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) [5ffcde86] Checking autorecoverable hosts >2012-08-07 07:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) [5ffcde86] Autorecovering 0 hosts >2012-08-07 07:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) [5ffcde86] Checking autorecoverable hosts done >2012-08-07 07:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) [5ffcde86] Checking autorecoverable storage domains >2012-08-07 07:35:00,038 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) [5ffcde86] Autorecovering 1 storage domains >2012-08-07 07:35:00,041 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) [5ffcde86] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 07:35:00,051 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [7eaa3da8] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:35:00,097 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [7eaa3da8] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 07:35:00,113 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [7eaa3da8] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:35:00,117 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [7eaa3da8] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 7:35 AM >2012-08-07 07:35:00,133 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [7eaa3da8] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 7e7c8c6d >2012-08-07 07:38:00,137 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [7eaa3da8] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 07:38:00,138 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [7eaa3da8] FINISH, ConnectStorageServerVDSCommand, log id: 7e7c8c6d >2012-08-07 07:38:00,140 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [7eaa3da8] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 07:38:00,173 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [7eaa3da8] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 7:38 AM >2012-08-07 07:38:00,174 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-92) [7eaa3da8] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 5b645af >2012-08-07 07:38:00,429 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-92) [7eaa3da8] Failed in ActivateStorageDomainVDS method >2012-08-07 07:38:00,429 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-92) [7eaa3da8] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:38:00,431 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-92) [7eaa3da8] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:38:00,437 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-92) [7eaa3da8] FINISH, ActivateStorageDomainVDSCommand, log id: 5b645af >2012-08-07 07:38:00,441 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [7eaa3da8] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:38:00,455 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [7eaa3da8] Command [id=0a8368e9-d7e7-490b-b397-9b28f47942fb]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 07:38:00,482 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) [7eaa3da8] Checking autorecoverable storage domains done >2012-08-07 07:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) [4bc242c7] Checking autorecoverable hosts >2012-08-07 07:40:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) [4bc242c7] Autorecovering 0 hosts >2012-08-07 07:40:00,032 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) [4bc242c7] Checking autorecoverable hosts done >2012-08-07 07:40:00,035 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) [4bc242c7] Checking autorecoverable storage domains >2012-08-07 07:40:00,061 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) [4bc242c7] Autorecovering 1 storage domains >2012-08-07 07:40:00,063 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) [4bc242c7] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 07:40:00,068 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [583427a4] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:40:00,138 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [583427a4] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 07:40:00,156 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [583427a4] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:40:00,160 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [583427a4] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 7:40 AM >2012-08-07 07:40:00,176 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [583427a4] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 2183fccf >2012-08-07 07:43:00,182 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [583427a4] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 07:43:00,183 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [583427a4] FINISH, ConnectStorageServerVDSCommand, log id: 2183fccf >2012-08-07 07:43:00,184 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [583427a4] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 07:43:00,214 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [583427a4] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 7:43 AM >2012-08-07 07:43:00,215 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-58) [583427a4] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 4eeed7de >2012-08-07 07:43:00,466 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-58) [583427a4] Failed in ActivateStorageDomainVDS method >2012-08-07 07:43:00,467 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-58) [583427a4] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:43:00,468 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-58) [583427a4] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:43:00,475 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-58) [583427a4] FINISH, ActivateStorageDomainVDSCommand, log id: 4eeed7de >2012-08-07 07:43:00,479 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [583427a4] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:43:00,489 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [583427a4] Command [id=2fc4e292-e68f-4528-b6ce-936b53a70d92]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 07:43:00,510 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) [583427a4] Checking autorecoverable storage domains done >2012-08-07 07:43:07,339 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-76) DbUserCacheManager::refreshAllUserData() - entered >2012-08-07 07:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) [1f9e7a7] Checking autorecoverable hosts >2012-08-07 07:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) [1f9e7a7] Autorecovering 0 hosts >2012-08-07 07:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) [1f9e7a7] Checking autorecoverable hosts done >2012-08-07 07:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) [1f9e7a7] Checking autorecoverable storage domains >2012-08-07 07:45:00,046 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) [1f9e7a7] Autorecovering 1 storage domains >2012-08-07 07:45:00,050 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) [1f9e7a7] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 07:45:00,055 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-90) [5f31f664] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:45:00,154 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-90) [5f31f664] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 07:45:00,178 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-90) [5f31f664] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:45:00,183 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-90) [5f31f664] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 7:45 AM >2012-08-07 07:45:00,200 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [5f31f664] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 7bd92057 >2012-08-07 07:48:00,203 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [5f31f664] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 07:48:00,205 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [5f31f664] FINISH, ConnectStorageServerVDSCommand, log id: 7bd92057 >2012-08-07 07:48:00,206 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [5f31f664] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 07:48:00,237 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-90) [5f31f664] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 7:48 AM >2012-08-07 07:48:00,238 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-90) [5f31f664] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 284710c1 >2012-08-07 07:48:00,491 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-90) [5f31f664] Failed in ActivateStorageDomainVDS method >2012-08-07 07:48:00,492 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-90) [5f31f664] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:48:00,493 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [5f31f664] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:48:00,497 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-90) [5f31f664] FINISH, ActivateStorageDomainVDSCommand, log id: 284710c1 >2012-08-07 07:48:00,501 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-90) [5f31f664] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:48:00,512 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-90) [5f31f664] Command [id=75d149ae-33a0-4cee-b7e4-25c4b32f6c75]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 07:48:00,533 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) [5f31f664] Checking autorecoverable storage domains done >2012-08-07 07:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable hosts >2012-08-07 07:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Autorecovering 0 hosts >2012-08-07 07:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable hosts done >2012-08-07 07:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Checking autorecoverable storage domains >2012-08-07 07:50:00,051 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Autorecovering 1 storage domains >2012-08-07 07:50:00,053 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 07:50:00,057 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-6) [27385f9d] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:50:00,100 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-6) [27385f9d] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 07:50:00,126 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-6) [27385f9d] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:50:00,131 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-6) [27385f9d] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 7:50 AM >2012-08-07 07:50:00,148 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [27385f9d] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 72571c91 >2012-08-07 07:53:00,151 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [27385f9d] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 07:53:00,153 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [27385f9d] FINISH, ConnectStorageServerVDSCommand, log id: 72571c91 >2012-08-07 07:53:00,153 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [27385f9d] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 07:53:00,184 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-6) [27385f9d] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 7:53 AM >2012-08-07 07:53:00,185 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-6) [27385f9d] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: cfd7684 >2012-08-07 07:53:00,449 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-6) [27385f9d] Failed in ActivateStorageDomainVDS method >2012-08-07 07:53:00,449 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-6) [27385f9d] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:53:00,451 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) [27385f9d] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:53:00,457 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-6) [27385f9d] FINISH, ActivateStorageDomainVDSCommand, log id: cfd7684 >2012-08-07 07:53:00,460 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-6) [27385f9d] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:53:00,470 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-6) [27385f9d] Command [id=6114d320-eb5f-4008-b8ca-80079debd581]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 07:53:00,503 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) [27385f9d] Checking autorecoverable storage domains done >2012-08-07 07:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) [36f6854] Checking autorecoverable hosts >2012-08-07 07:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) [36f6854] Autorecovering 0 hosts >2012-08-07 07:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) [36f6854] Checking autorecoverable hosts done >2012-08-07 07:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) [36f6854] Checking autorecoverable storage domains >2012-08-07 07:55:00,058 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) [36f6854] Autorecovering 1 storage domains >2012-08-07 07:55:00,060 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) [36f6854] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 07:55:00,071 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-31) [c77b3e2] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:55:00,112 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-31) [c77b3e2] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 07:55:00,135 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-31) [c77b3e2] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 07:55:00,139 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-31) [c77b3e2] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 7:55 AM >2012-08-07 07:55:00,156 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [c77b3e2] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 78aa8192 >2012-08-07 07:58:00,159 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [c77b3e2] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 07:58:00,161 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [c77b3e2] FINISH, ConnectStorageServerVDSCommand, log id: 78aa8192 >2012-08-07 07:58:00,161 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [c77b3e2] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 07:58:00,210 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-31) [c77b3e2] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 7:58 AM >2012-08-07 07:58:00,211 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-31) [c77b3e2] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 789a0273 >2012-08-07 07:58:00,463 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-31) [c77b3e2] Failed in ActivateStorageDomainVDS method >2012-08-07 07:58:00,463 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-31) [c77b3e2] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:58:00,465 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) [c77b3e2] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:58:00,471 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-31) [c77b3e2] FINISH, ActivateStorageDomainVDSCommand, log id: 789a0273 >2012-08-07 07:58:00,474 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-31) [c77b3e2] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 07:58:00,485 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-31) [c77b3e2] Command [id=f85fd4c2-6717-4616-b791-0807ead9e302]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 07:58:00,508 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) [c77b3e2] Checking autorecoverable storage domains done >2012-08-07 08:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) [3f5b95e0] Checking autorecoverable hosts >2012-08-07 08:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) [3f5b95e0] Autorecovering 0 hosts >2012-08-07 08:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) [3f5b95e0] Checking autorecoverable hosts done >2012-08-07 08:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) [3f5b95e0] Checking autorecoverable storage domains >2012-08-07 08:00:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) [3f5b95e0] Autorecovering 1 storage domains >2012-08-07 08:00:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) [3f5b95e0] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 08:00:00,027 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-20) [7b01d83f] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:00:00,080 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-20) [7b01d83f] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 08:00:00,104 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-20) [7b01d83f] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:00:00,109 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-20) [7b01d83f] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 8:00 AM >2012-08-07 08:00:00,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [7b01d83f] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 4f08cf39 >2012-08-07 08:03:00,129 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [7b01d83f] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 08:03:00,130 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [7b01d83f] FINISH, ConnectStorageServerVDSCommand, log id: 4f08cf39 >2012-08-07 08:03:00,131 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [7b01d83f] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 08:03:00,162 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-20) [7b01d83f] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 8:03 AM >2012-08-07 08:03:00,163 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-20) [7b01d83f] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 1009339c >2012-08-07 08:03:00,458 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-20) [7b01d83f] Failed in ActivateStorageDomainVDS method >2012-08-07 08:03:00,459 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-20) [7b01d83f] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:03:00,462 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) [7b01d83f] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:03:00,470 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-20) [7b01d83f] FINISH, ActivateStorageDomainVDSCommand, log id: 1009339c >2012-08-07 08:03:00,473 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-20) [7b01d83f] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:03:00,484 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-20) [7b01d83f] Command [id=68820d68-7af7-4263-90ad-04abdd3d9dde]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 08:03:00,554 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) [7b01d83f] Checking autorecoverable storage domains done >2012-08-07 08:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) [583427a4] Checking autorecoverable hosts >2012-08-07 08:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) [583427a4] Autorecovering 0 hosts >2012-08-07 08:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) [583427a4] Checking autorecoverable hosts done >2012-08-07 08:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) [583427a4] Checking autorecoverable storage domains >2012-08-07 08:05:00,031 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) [583427a4] Autorecovering 1 storage domains >2012-08-07 08:05:00,033 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) [583427a4] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 08:05:00,038 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [271b4dca] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:05:00,099 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [271b4dca] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 08:05:00,148 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [271b4dca] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:05:00,153 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [271b4dca] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 8:05 AM >2012-08-07 08:05:00,170 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [271b4dca] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 15cf322a >2012-08-07 08:08:00,175 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [271b4dca] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 08:08:00,176 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [271b4dca] FINISH, ConnectStorageServerVDSCommand, log id: 15cf322a >2012-08-07 08:08:00,177 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [271b4dca] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 08:08:00,207 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [271b4dca] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 8:08 AM >2012-08-07 08:08:00,208 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-58) [271b4dca] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 3cde385d >2012-08-07 08:08:00,459 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-58) [271b4dca] Failed in ActivateStorageDomainVDS method >2012-08-07 08:08:00,460 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-58) [271b4dca] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:08:00,461 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-58) [271b4dca] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:08:00,468 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-58) [271b4dca] FINISH, ActivateStorageDomainVDSCommand, log id: 3cde385d >2012-08-07 08:08:00,472 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [271b4dca] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:08:00,482 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-58) [271b4dca] Command [id=ba26bc32-8317-4190-8c2e-3db2b6ca256e]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 08:08:00,509 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) [271b4dca] Checking autorecoverable storage domains done >2012-08-07 08:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) [68f0f156] Checking autorecoverable hosts >2012-08-07 08:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) [68f0f156] Autorecovering 0 hosts >2012-08-07 08:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) [68f0f156] Checking autorecoverable hosts done >2012-08-07 08:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) [68f0f156] Checking autorecoverable storage domains >2012-08-07 08:10:00,035 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) [68f0f156] Autorecovering 1 storage domains >2012-08-07 08:10:00,038 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) [68f0f156] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 08:10:00,043 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-83) [f129e7a] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:10:00,090 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-83) [f129e7a] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 08:10:00,106 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-83) [f129e7a] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:10:00,113 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-83) [f129e7a] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 8:10 AM >2012-08-07 08:10:00,135 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [f129e7a] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 44303a95 >2012-08-07 08:13:00,139 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [f129e7a] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 08:13:00,141 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [f129e7a] FINISH, ConnectStorageServerVDSCommand, log id: 44303a95 >2012-08-07 08:13:00,143 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [f129e7a] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 08:13:00,174 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-83) [f129e7a] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 8:13 AM >2012-08-07 08:13:00,175 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-83) [f129e7a] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 2df1f4dd >2012-08-07 08:13:00,428 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-83) [f129e7a] Failed in ActivateStorageDomainVDS method >2012-08-07 08:13:00,428 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-83) [f129e7a] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:13:00,430 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-83) [f129e7a] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:13:00,435 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-83) [f129e7a] FINISH, ActivateStorageDomainVDSCommand, log id: 2df1f4dd >2012-08-07 08:13:00,439 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-83) [f129e7a] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:13:00,449 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-83) [f129e7a] Command [id=233d089a-bd6c-4b44-8dff-2735c14324fb]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 08:13:00,476 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) [f129e7a] Checking autorecoverable storage domains done >2012-08-07 08:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [2948a4ed] Checking autorecoverable hosts >2012-08-07 08:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [2948a4ed] Autorecovering 0 hosts >2012-08-07 08:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [2948a4ed] Checking autorecoverable hosts done >2012-08-07 08:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [2948a4ed] Checking autorecoverable storage domains >2012-08-07 08:15:00,030 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [2948a4ed] Autorecovering 1 storage domains >2012-08-07 08:15:00,033 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [2948a4ed] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 08:15:00,037 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [a2d611b] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:15:00,071 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [a2d611b] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 08:15:00,091 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [a2d611b] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:15:00,095 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [a2d611b] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 8:15 AM >2012-08-07 08:15:00,124 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [a2d611b] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 2fe42b29 >2012-08-07 08:18:00,129 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [a2d611b] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 08:18:00,130 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [a2d611b] FINISH, ConnectStorageServerVDSCommand, log id: 2fe42b29 >2012-08-07 08:18:00,134 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [a2d611b] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 08:18:00,166 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [a2d611b] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 8:18 AM >2012-08-07 08:18:00,167 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-69) [a2d611b] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 38efcd35 >2012-08-07 08:18:00,420 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-69) [a2d611b] Failed in ActivateStorageDomainVDS method >2012-08-07 08:18:00,421 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-69) [a2d611b] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:18:00,422 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) [a2d611b] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:18:00,429 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-69) [a2d611b] FINISH, ActivateStorageDomainVDSCommand, log id: 38efcd35 >2012-08-07 08:18:00,433 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [a2d611b] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:18:00,443 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-69) [a2d611b] Command [id=6e4dfc1b-3f32-4f2a-82a8-1384297d0686]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 08:18:00,461 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [a2d611b] Checking autorecoverable storage domains done >2012-08-07 08:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [6b6e53e0] Checking autorecoverable hosts >2012-08-07 08:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [6b6e53e0] Autorecovering 0 hosts >2012-08-07 08:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [6b6e53e0] Checking autorecoverable hosts done >2012-08-07 08:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [6b6e53e0] Checking autorecoverable storage domains >2012-08-07 08:20:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [6b6e53e0] Autorecovering 1 storage domains >2012-08-07 08:20:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [6b6e53e0] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 08:20:00,035 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [201cee8c] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:20:00,083 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [201cee8c] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 08:20:00,097 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [201cee8c] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:20:00,102 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [201cee8c] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 8:20 AM >2012-08-07 08:20:00,118 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [201cee8c] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 71aae710 >2012-08-07 08:23:00,121 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [201cee8c] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 08:23:00,122 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [201cee8c] FINISH, ConnectStorageServerVDSCommand, log id: 71aae710 >2012-08-07 08:23:00,123 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [201cee8c] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 08:23:00,160 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [201cee8c] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 8:23 AM >2012-08-07 08:23:00,161 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-81) [201cee8c] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 7badf865 >2012-08-07 08:23:00,417 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-81) [201cee8c] Failed in ActivateStorageDomainVDS method >2012-08-07 08:23:00,418 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-81) [201cee8c] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:23:00,428 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-81) [201cee8c] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:23:00,436 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-81) [201cee8c] FINISH, ActivateStorageDomainVDSCommand, log id: 7badf865 >2012-08-07 08:23:00,441 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [201cee8c] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:23:00,451 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [201cee8c] Command [id=dfbc9eca-512c-4dfb-bf02-9f1edf301c34]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 08:23:00,481 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [201cee8c] Checking autorecoverable storage domains done >2012-08-07 08:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [16a93396] Checking autorecoverable hosts >2012-08-07 08:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [16a93396] Autorecovering 0 hosts >2012-08-07 08:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [16a93396] Checking autorecoverable hosts done >2012-08-07 08:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [16a93396] Checking autorecoverable storage domains >2012-08-07 08:25:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [16a93396] Autorecovering 1 storage domains >2012-08-07 08:25:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [16a93396] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 08:25:00,030 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [7716bd46] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:25:00,077 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [7716bd46] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 08:25:00,093 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [7716bd46] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:25:00,103 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [7716bd46] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 8:25 AM >2012-08-07 08:25:00,137 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [7716bd46] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 5a4dabb4 >2012-08-07 08:28:00,146 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [7716bd46] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 08:28:00,149 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [7716bd46] FINISH, ConnectStorageServerVDSCommand, log id: 5a4dabb4 >2012-08-07 08:28:00,153 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [7716bd46] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 08:28:00,181 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [7716bd46] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 8:28 AM >2012-08-07 08:28:00,182 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-17) [7716bd46] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 2ac235c8 >2012-08-07 08:28:00,438 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-17) [7716bd46] Failed in ActivateStorageDomainVDS method >2012-08-07 08:28:00,439 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-17) [7716bd46] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:28:00,442 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) [7716bd46] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:28:00,450 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-17) [7716bd46] FINISH, ActivateStorageDomainVDSCommand, log id: 2ac235c8 >2012-08-07 08:28:00,453 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [7716bd46] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:28:00,463 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [7716bd46] Command [id=40b894e0-0132-4079-a54c-04a4c8643d5c]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 08:28:00,487 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [7716bd46] Checking autorecoverable storage domains done >2012-08-07 08:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [61023e04] Checking autorecoverable hosts >2012-08-07 08:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [61023e04] Autorecovering 0 hosts >2012-08-07 08:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [61023e04] Checking autorecoverable hosts done >2012-08-07 08:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [61023e04] Checking autorecoverable storage domains >2012-08-07 08:30:00,045 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [61023e04] Autorecovering 1 storage domains >2012-08-07 08:30:00,048 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [61023e04] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 08:30:00,053 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [673c3f7f] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:30:00,102 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [673c3f7f] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 08:30:00,128 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [673c3f7f] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:30:00,129 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [673c3f7f] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 8:30 AM >2012-08-07 08:30:00,146 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [673c3f7f] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 3e2a78f5 >2012-08-07 08:33:00,157 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [673c3f7f] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 08:33:00,163 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [673c3f7f] FINISH, ConnectStorageServerVDSCommand, log id: 3e2a78f5 >2012-08-07 08:33:00,167 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [673c3f7f] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 08:33:00,197 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [673c3f7f] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 8:33 AM >2012-08-07 08:33:00,199 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-35) [673c3f7f] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 6abada5b >2012-08-07 08:33:00,455 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-35) [673c3f7f] Failed in ActivateStorageDomainVDS method >2012-08-07 08:33:00,455 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-35) [673c3f7f] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:33:00,461 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-35) [673c3f7f] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:33:00,467 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-35) [673c3f7f] FINISH, ActivateStorageDomainVDSCommand, log id: 6abada5b >2012-08-07 08:33:00,470 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [673c3f7f] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:33:00,485 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [673c3f7f] Command [id=9264f5d0-199e-4406-84f2-00ed7c027b3f]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 08:33:00,512 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [673c3f7f] Checking autorecoverable storage domains done >2012-08-07 08:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) [1ff44d1b] Checking autorecoverable hosts >2012-08-07 08:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) [1ff44d1b] Autorecovering 0 hosts >2012-08-07 08:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) [1ff44d1b] Checking autorecoverable hosts done >2012-08-07 08:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) [1ff44d1b] Checking autorecoverable storage domains >2012-08-07 08:35:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) [1ff44d1b] Autorecovering 1 storage domains >2012-08-07 08:35:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) [1ff44d1b] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 08:35:00,027 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [39ead820] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:35:00,067 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [39ead820] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 08:35:00,087 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [39ead820] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:35:00,091 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [39ead820] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 8:35 AM >2012-08-07 08:35:00,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [39ead820] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 65f8aef3 >2012-08-07 08:38:00,116 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [39ead820] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 08:38:00,117 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [39ead820] FINISH, ConnectStorageServerVDSCommand, log id: 65f8aef3 >2012-08-07 08:38:00,117 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [39ead820] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 08:38:00,148 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [39ead820] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 8:38 AM >2012-08-07 08:38:00,149 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-30) [39ead820] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 6431f55a >2012-08-07 08:38:00,431 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-30) [39ead820] Failed in ActivateStorageDomainVDS method >2012-08-07 08:38:00,432 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-30) [39ead820] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:38:00,433 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-30) [39ead820] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:38:00,441 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-30) [39ead820] FINISH, ActivateStorageDomainVDSCommand, log id: 6431f55a >2012-08-07 08:38:00,445 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [39ead820] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:38:00,456 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [39ead820] Command [id=b07c81f6-8502-4295-9aa5-901b4719b30e]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 08:38:00,486 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) [39ead820] Checking autorecoverable storage domains done >2012-08-07 08:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [5a58521c] Checking autorecoverable hosts >2012-08-07 08:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [5a58521c] Autorecovering 0 hosts >2012-08-07 08:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [5a58521c] Checking autorecoverable hosts done >2012-08-07 08:40:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [5a58521c] Checking autorecoverable storage domains >2012-08-07 08:40:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [5a58521c] Autorecovering 1 storage domains >2012-08-07 08:40:00,031 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [5a58521c] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 08:40:00,036 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [5f73508f] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:40:00,081 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [5f73508f] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 08:40:00,128 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [5f73508f] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:40:00,129 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [5f73508f] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 8:40 AM >2012-08-07 08:40:00,146 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [5f73508f] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 771c2851 >2012-08-07 08:43:00,149 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [5f73508f] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 08:43:00,151 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [5f73508f] FINISH, ConnectStorageServerVDSCommand, log id: 771c2851 >2012-08-07 08:43:00,151 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [5f73508f] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 08:43:00,184 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [5f73508f] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 8:43 AM >2012-08-07 08:43:00,185 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-52) [5f73508f] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 2abd0632 >2012-08-07 08:43:00,496 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-52) [5f73508f] Failed in ActivateStorageDomainVDS method >2012-08-07 08:43:00,496 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-52) [5f73508f] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:43:00,504 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) [5f73508f] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:43:00,513 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-52) [5f73508f] FINISH, ActivateStorageDomainVDSCommand, log id: 2abd0632 >2012-08-07 08:43:00,518 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [5f73508f] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:43:00,532 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [5f73508f] Command [id=c2c54f77-e6c3-41ed-be21-ccb4c791099c]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 08:43:00,566 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [5f73508f] Checking autorecoverable storage domains done >2012-08-07 08:43:07,342 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-4) [6333ff61] DbUserCacheManager::refreshAllUserData() - entered >2012-08-07 08:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) [2aa3a675] Checking autorecoverable hosts >2012-08-07 08:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) [2aa3a675] Autorecovering 0 hosts >2012-08-07 08:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) [2aa3a675] Checking autorecoverable hosts done >2012-08-07 08:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) [2aa3a675] Checking autorecoverable storage domains >2012-08-07 08:45:00,025 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) [2aa3a675] Autorecovering 1 storage domains >2012-08-07 08:45:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) [2aa3a675] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 08:45:00,028 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [167565ab] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:45:00,069 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [167565ab] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 08:45:00,087 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [167565ab] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:45:00,092 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [167565ab] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 8:45 AM >2012-08-07 08:45:00,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [167565ab] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 20668f65 >2012-08-07 08:48:00,115 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [167565ab] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 08:48:00,116 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [167565ab] FINISH, ConnectStorageServerVDSCommand, log id: 20668f65 >2012-08-07 08:48:00,120 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [167565ab] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 08:48:00,160 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [167565ab] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 8:48 AM >2012-08-07 08:48:00,161 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-74) [167565ab] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 49a10f8b >2012-08-07 08:48:00,420 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-74) [167565ab] Failed in ActivateStorageDomainVDS method >2012-08-07 08:48:00,421 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-74) [167565ab] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:48:00,422 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [167565ab] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:48:00,431 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-74) [167565ab] FINISH, ActivateStorageDomainVDSCommand, log id: 49a10f8b >2012-08-07 08:48:00,435 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [167565ab] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:48:00,446 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [167565ab] Command [id=551bbba5-5274-414a-ae6e-e25d886693a2]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 08:48:00,473 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) [167565ab] Checking autorecoverable storage domains done >2012-08-07 08:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [7716bd46] Checking autorecoverable hosts >2012-08-07 08:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [7716bd46] Autorecovering 0 hosts >2012-08-07 08:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [7716bd46] Checking autorecoverable hosts done >2012-08-07 08:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [7716bd46] Checking autorecoverable storage domains >2012-08-07 08:50:00,056 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [7716bd46] Autorecovering 1 storage domains >2012-08-07 08:50:00,059 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [7716bd46] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 08:50:00,068 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [36c23662] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:50:00,106 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [36c23662] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 08:50:00,141 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [36c23662] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:50:00,148 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [36c23662] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 8:50 AM >2012-08-07 08:50:00,164 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [36c23662] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 425e28bf >2012-08-07 08:53:00,180 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [36c23662] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 08:53:00,181 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [36c23662] FINISH, ConnectStorageServerVDSCommand, log id: 425e28bf >2012-08-07 08:53:00,182 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [36c23662] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 08:53:00,217 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [36c23662] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 8:53 AM >2012-08-07 08:53:00,217 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-17) [36c23662] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 5107a90c >2012-08-07 08:53:00,480 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-17) [36c23662] Failed in ActivateStorageDomainVDS method >2012-08-07 08:53:00,481 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-17) [36c23662] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:53:00,485 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) [36c23662] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:53:00,491 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-17) [36c23662] FINISH, ActivateStorageDomainVDSCommand, log id: 5107a90c >2012-08-07 08:53:00,495 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [36c23662] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:53:00,505 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-17) [36c23662] Command [id=32d44437-4171-4506-b6ca-aaf3c133626a]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 08:53:00,549 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [36c23662] Checking autorecoverable storage domains done >2012-08-07 08:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [362c625e] Checking autorecoverable hosts >2012-08-07 08:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [362c625e] Autorecovering 0 hosts >2012-08-07 08:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [362c625e] Checking autorecoverable hosts done >2012-08-07 08:55:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [362c625e] Checking autorecoverable storage domains >2012-08-07 08:55:00,047 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [362c625e] Autorecovering 1 storage domains >2012-08-07 08:55:00,048 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [362c625e] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 08:55:00,050 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [7351b0c2] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:55:00,104 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [7351b0c2] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 08:55:00,143 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [7351b0c2] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 08:55:00,147 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [7351b0c2] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 8:55 AM >2012-08-07 08:55:00,183 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [7351b0c2] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 54ec05cc >2012-08-07 08:58:00,187 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [7351b0c2] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 08:58:00,188 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [7351b0c2] FINISH, ConnectStorageServerVDSCommand, log id: 54ec05cc >2012-08-07 08:58:00,189 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [7351b0c2] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 08:58:00,221 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [7351b0c2] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 8:58 AM >2012-08-07 08:58:00,222 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-42) [7351b0c2] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 3c1bc872 >2012-08-07 08:58:00,477 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-42) [7351b0c2] Failed in ActivateStorageDomainVDS method >2012-08-07 08:58:00,478 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-42) [7351b0c2] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:58:00,479 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) [7351b0c2] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:58:00,488 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-42) [7351b0c2] FINISH, ActivateStorageDomainVDSCommand, log id: 3c1bc872 >2012-08-07 08:58:00,491 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [7351b0c2] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 08:58:00,501 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [7351b0c2] Command [id=a680ad70-345f-4fee-ada5-55d476f5b819]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 08:58:00,523 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [7351b0c2] Checking autorecoverable storage domains done >2012-08-07 09:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) [f129e7a] Checking autorecoverable hosts >2012-08-07 09:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) [f129e7a] Autorecovering 0 hosts >2012-08-07 09:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) [f129e7a] Checking autorecoverable hosts done >2012-08-07 09:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) [f129e7a] Checking autorecoverable storage domains >2012-08-07 09:00:00,045 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) [f129e7a] Autorecovering 1 storage domains >2012-08-07 09:00:00,048 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) [f129e7a] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 09:00:00,056 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-83) [77c24347] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:00:00,107 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-83) [77c24347] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 09:00:00,128 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-83) [77c24347] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:00:00,129 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-83) [77c24347] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 9:00 AM >2012-08-07 09:00:00,157 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [77c24347] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 492a6f4c >2012-08-07 09:03:00,161 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [77c24347] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 09:03:00,162 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [77c24347] FINISH, ConnectStorageServerVDSCommand, log id: 492a6f4c >2012-08-07 09:03:00,165 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [77c24347] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 09:03:00,198 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-83) [77c24347] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 9:03 AM >2012-08-07 09:03:00,199 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-83) [77c24347] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 4262306f >2012-08-07 09:03:00,472 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-83) [77c24347] Failed in ActivateStorageDomainVDS method >2012-08-07 09:03:00,473 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-83) [77c24347] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:03:00,474 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-83) [77c24347] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:03:00,482 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-83) [77c24347] FINISH, ActivateStorageDomainVDSCommand, log id: 4262306f >2012-08-07 09:03:00,490 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-83) [77c24347] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:03:00,508 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-83) [77c24347] Command [id=97cc5f39-c6fe-4a73-819e-44b7279fb18e]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 09:03:00,533 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) [77c24347] Checking autorecoverable storage domains done >2012-08-07 09:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) [32e754a1] Checking autorecoverable hosts >2012-08-07 09:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) [32e754a1] Autorecovering 0 hosts >2012-08-07 09:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) [32e754a1] Checking autorecoverable hosts done >2012-08-07 09:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) [32e754a1] Checking autorecoverable storage domains >2012-08-07 09:05:00,033 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) [32e754a1] Autorecovering 1 storage domains >2012-08-07 09:05:00,036 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) [32e754a1] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 09:05:00,041 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-3) [748462f0] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:05:00,092 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-3) [748462f0] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 09:05:00,126 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-3) [748462f0] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:05:00,131 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-3) [748462f0] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 9:05 AM >2012-08-07 09:05:00,147 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [748462f0] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 541c7020 >2012-08-07 09:08:00,151 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [748462f0] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 09:08:00,152 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [748462f0] FINISH, ConnectStorageServerVDSCommand, log id: 541c7020 >2012-08-07 09:08:00,155 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [748462f0] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 09:08:00,187 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-3) [748462f0] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 9:08 AM >2012-08-07 09:08:00,188 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-3) [748462f0] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 6bc71734 >2012-08-07 09:08:00,444 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-3) [748462f0] Failed in ActivateStorageDomainVDS method >2012-08-07 09:08:00,444 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-3) [748462f0] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:08:00,448 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-3) [748462f0] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:08:00,455 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-3) [748462f0] FINISH, ActivateStorageDomainVDSCommand, log id: 6bc71734 >2012-08-07 09:08:00,459 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-3) [748462f0] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:08:00,469 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-3) [748462f0] Command [id=22031453-6943-433e-95bc-31776f8cf3bd]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 09:08:00,490 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) [748462f0] Checking autorecoverable storage domains done >2012-08-07 09:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) [3dcf7973] Checking autorecoverable hosts >2012-08-07 09:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) [3dcf7973] Autorecovering 0 hosts >2012-08-07 09:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) [3dcf7973] Checking autorecoverable hosts done >2012-08-07 09:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) [3dcf7973] Checking autorecoverable storage domains >2012-08-07 09:10:00,022 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) [3dcf7973] Autorecovering 1 storage domains >2012-08-07 09:10:00,025 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) [3dcf7973] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 09:10:00,029 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-44) [18c7ab28] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:10:00,081 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-44) [18c7ab28] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 09:10:00,098 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-44) [18c7ab28] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:10:00,103 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-44) [18c7ab28] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 9:10 AM >2012-08-07 09:10:00,119 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [18c7ab28] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 79706570 >2012-08-07 09:13:00,130 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [18c7ab28] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 09:13:00,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [18c7ab28] FINISH, ConnectStorageServerVDSCommand, log id: 79706570 >2012-08-07 09:13:00,132 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [18c7ab28] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 09:13:00,165 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-44) [18c7ab28] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 9:13 AM >2012-08-07 09:13:00,166 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-44) [18c7ab28] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 7597446b >2012-08-07 09:13:00,430 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-44) [18c7ab28] Failed in ActivateStorageDomainVDS method >2012-08-07 09:13:00,431 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-44) [18c7ab28] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:13:00,435 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) [18c7ab28] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:13:00,443 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-44) [18c7ab28] FINISH, ActivateStorageDomainVDSCommand, log id: 7597446b >2012-08-07 09:13:00,446 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-44) [18c7ab28] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:13:00,463 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-44) [18c7ab28] Command [id=933b0a79-ab54-46fc-8356-32d87ae1805a]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 09:13:00,489 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) [18c7ab28] Checking autorecoverable storage domains done >2012-08-07 09:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable hosts >2012-08-07 09:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Autorecovering 0 hosts >2012-08-07 09:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable hosts done >2012-08-07 09:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable storage domains >2012-08-07 09:15:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Autorecovering 1 storage domains >2012-08-07 09:15:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 09:15:00,030 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-57) [34248336] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:15:00,083 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-57) [34248336] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 09:15:00,106 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-57) [34248336] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:15:00,110 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-57) [34248336] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 9:15 AM >2012-08-07 09:15:00,127 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [34248336] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 39b46c99 >2012-08-07 09:18:00,131 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [34248336] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 09:18:00,132 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [34248336] FINISH, ConnectStorageServerVDSCommand, log id: 39b46c99 >2012-08-07 09:18:00,133 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [34248336] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 09:18:00,161 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-57) [34248336] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 9:18 AM >2012-08-07 09:18:00,162 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-57) [34248336] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 7723ef7b >2012-08-07 09:18:00,415 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-57) [34248336] Failed in ActivateStorageDomainVDS method >2012-08-07 09:18:00,416 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-57) [34248336] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:18:00,419 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) [34248336] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:18:00,426 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-57) [34248336] FINISH, ActivateStorageDomainVDSCommand, log id: 7723ef7b >2012-08-07 09:18:00,430 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-57) [34248336] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:18:00,440 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-57) [34248336] Command [id=7fdcb375-1aab-433a-8455-18c23161e5e5]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 09:18:00,471 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) [34248336] Checking autorecoverable storage domains done >2012-08-07 09:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [7351b0c2] Checking autorecoverable hosts >2012-08-07 09:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [7351b0c2] Autorecovering 0 hosts >2012-08-07 09:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [7351b0c2] Checking autorecoverable hosts done >2012-08-07 09:20:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [7351b0c2] Checking autorecoverable storage domains >2012-08-07 09:20:00,061 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [7351b0c2] Autorecovering 1 storage domains >2012-08-07 09:20:00,063 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [7351b0c2] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 09:20:00,068 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [5a8b1ea7] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:20:00,189 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [5a8b1ea7] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 09:20:00,228 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [5a8b1ea7] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:20:00,233 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [5a8b1ea7] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 9:20 AM >2012-08-07 09:20:00,253 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [5a8b1ea7] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 6fd7d5e2 >2012-08-07 09:23:00,257 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [5a8b1ea7] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 09:23:00,258 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [5a8b1ea7] FINISH, ConnectStorageServerVDSCommand, log id: 6fd7d5e2 >2012-08-07 09:23:00,259 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [5a8b1ea7] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 09:23:00,295 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [5a8b1ea7] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 9:23 AM >2012-08-07 09:23:00,296 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-42) [5a8b1ea7] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 47bf17b2 >2012-08-07 09:23:00,554 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-42) [5a8b1ea7] Failed in ActivateStorageDomainVDS method >2012-08-07 09:23:00,555 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-42) [5a8b1ea7] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:23:00,556 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) [5a8b1ea7] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:23:00,562 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-42) [5a8b1ea7] FINISH, ActivateStorageDomainVDSCommand, log id: 47bf17b2 >2012-08-07 09:23:00,566 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [5a8b1ea7] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:23:00,576 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [5a8b1ea7] Command [id=cb9c3f80-f005-4d0c-89b5-fb9e4e2f7d77]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 09:23:00,599 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [5a8b1ea7] Checking autorecoverable storage domains done >2012-08-07 09:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) [66bc13b7] Checking autorecoverable hosts >2012-08-07 09:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) [66bc13b7] Autorecovering 0 hosts >2012-08-07 09:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) [66bc13b7] Checking autorecoverable hosts done >2012-08-07 09:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) [66bc13b7] Checking autorecoverable storage domains >2012-08-07 09:25:00,022 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) [66bc13b7] Autorecovering 1 storage domains >2012-08-07 09:25:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) [66bc13b7] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 09:25:00,026 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-24) [22c7cd0a] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:25:00,073 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-24) [22c7cd0a] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 09:25:00,102 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-24) [22c7cd0a] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:25:00,103 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-24) [22c7cd0a] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 9:25 AM >2012-08-07 09:25:00,128 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [22c7cd0a] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: e461517 >2012-08-07 09:28:00,132 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [22c7cd0a] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 09:28:00,135 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [22c7cd0a] FINISH, ConnectStorageServerVDSCommand, log id: e461517 >2012-08-07 09:28:00,138 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [22c7cd0a] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 09:28:00,167 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-24) [22c7cd0a] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 9:28 AM >2012-08-07 09:28:00,168 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-24) [22c7cd0a] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 638b62e7 >2012-08-07 09:28:00,421 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-24) [22c7cd0a] Failed in ActivateStorageDomainVDS method >2012-08-07 09:28:00,422 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-24) [22c7cd0a] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:28:00,425 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) [22c7cd0a] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:28:00,435 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-24) [22c7cd0a] FINISH, ActivateStorageDomainVDSCommand, log id: 638b62e7 >2012-08-07 09:28:00,440 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-24) [22c7cd0a] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:28:00,451 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-24) [22c7cd0a] Command [id=ae64accf-6008-4a26-b78e-0a916f5681a7]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 09:28:00,484 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) [22c7cd0a] Checking autorecoverable storage domains done >2012-08-07 09:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) [7eaa3da8] Checking autorecoverable hosts >2012-08-07 09:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) [7eaa3da8] Autorecovering 0 hosts >2012-08-07 09:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) [7eaa3da8] Checking autorecoverable hosts done >2012-08-07 09:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) [7eaa3da8] Checking autorecoverable storage domains >2012-08-07 09:30:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) [7eaa3da8] Autorecovering 1 storage domains >2012-08-07 09:30:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) [7eaa3da8] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 09:30:00,029 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [546de0f6] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:30:00,111 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [546de0f6] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 09:30:00,129 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [546de0f6] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:30:00,130 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [546de0f6] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 9:30 AM >2012-08-07 09:30:00,144 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [546de0f6] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 545d1541 >2012-08-07 09:33:00,153 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [546de0f6] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 09:33:00,154 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [546de0f6] FINISH, ConnectStorageServerVDSCommand, log id: 545d1541 >2012-08-07 09:33:00,154 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [546de0f6] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 09:33:00,186 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [546de0f6] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 9:33 AM >2012-08-07 09:33:00,187 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-92) [546de0f6] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 434069ac >2012-08-07 09:33:00,483 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-92) [546de0f6] Failed in ActivateStorageDomainVDS method >2012-08-07 09:33:00,483 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-92) [546de0f6] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:33:00,487 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-92) [546de0f6] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:33:00,498 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-92) [546de0f6] FINISH, ActivateStorageDomainVDSCommand, log id: 434069ac >2012-08-07 09:33:00,502 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [546de0f6] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:33:00,512 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [546de0f6] Command [id=82e09477-ea60-462e-81d7-4547ab718ca7]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 09:33:00,538 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) [546de0f6] Checking autorecoverable storage domains done >2012-08-07 09:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [58f6af40] Checking autorecoverable hosts >2012-08-07 09:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [58f6af40] Autorecovering 0 hosts >2012-08-07 09:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [58f6af40] Checking autorecoverable hosts done >2012-08-07 09:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [58f6af40] Checking autorecoverable storage domains >2012-08-07 09:35:00,049 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [58f6af40] Autorecovering 1 storage domains >2012-08-07 09:35:00,052 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [58f6af40] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 09:35:00,056 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [1f44175d] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:35:00,125 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [1f44175d] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 09:35:00,142 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [1f44175d] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:35:00,147 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [1f44175d] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 9:35 AM >2012-08-07 09:35:00,162 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [1f44175d] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 2cf1b7c5 >2012-08-07 09:38:00,170 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [1f44175d] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 09:38:00,171 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [1f44175d] FINISH, ConnectStorageServerVDSCommand, log id: 2cf1b7c5 >2012-08-07 09:38:00,172 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [1f44175d] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 09:38:00,205 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [1f44175d] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 9:38 AM >2012-08-07 09:38:00,207 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-93) [1f44175d] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 68da0dd4 >2012-08-07 09:38:00,491 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-93) [1f44175d] Failed in ActivateStorageDomainVDS method >2012-08-07 09:38:00,492 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-93) [1f44175d] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:38:00,496 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) [1f44175d] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:38:00,504 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-93) [1f44175d] FINISH, ActivateStorageDomainVDSCommand, log id: 68da0dd4 >2012-08-07 09:38:00,508 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [1f44175d] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:38:00,523 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [1f44175d] Command [id=52539d40-c6e9-4d82-9845-b622f1ed08bf]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 09:38:00,550 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [1f44175d] Checking autorecoverable storage domains done >2012-08-07 09:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) [6eb854d] Checking autorecoverable hosts >2012-08-07 09:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) [6eb854d] Autorecovering 0 hosts >2012-08-07 09:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) [6eb854d] Checking autorecoverable hosts done >2012-08-07 09:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) [6eb854d] Checking autorecoverable storage domains >2012-08-07 09:40:00,022 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) [6eb854d] Autorecovering 1 storage domains >2012-08-07 09:40:00,025 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) [6eb854d] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 09:40:00,030 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-71) [1fd26f44] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:40:00,071 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-71) [1fd26f44] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 09:40:00,089 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-71) [1fd26f44] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:40:00,093 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-71) [1fd26f44] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 9:40 AM >2012-08-07 09:40:00,110 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [1fd26f44] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 246e5580 >2012-08-07 09:43:00,114 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [1fd26f44] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 09:43:00,115 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [1fd26f44] FINISH, ConnectStorageServerVDSCommand, log id: 246e5580 >2012-08-07 09:43:00,116 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [1fd26f44] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 09:43:00,148 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-71) [1fd26f44] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 9:43 AM >2012-08-07 09:43:00,149 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-71) [1fd26f44] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 425bb1f6 >2012-08-07 09:43:00,448 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-71) [1fd26f44] Failed in ActivateStorageDomainVDS method >2012-08-07 09:43:00,448 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-71) [1fd26f44] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:43:00,454 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-71) [1fd26f44] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:43:00,462 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-71) [1fd26f44] FINISH, ActivateStorageDomainVDSCommand, log id: 425bb1f6 >2012-08-07 09:43:00,466 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-71) [1fd26f44] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:43:00,481 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-71) [1fd26f44] Command [id=a6b2c576-4031-475d-833c-5e963ddb7f2b]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 09:43:00,536 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) [1fd26f44] Checking autorecoverable storage domains done >2012-08-07 09:43:07,345 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-38) [4670e2e6] DbUserCacheManager::refreshAllUserData() - entered >2012-08-07 09:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) [3fa5778d] Checking autorecoverable hosts >2012-08-07 09:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) [3fa5778d] Autorecovering 0 hosts >2012-08-07 09:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) [3fa5778d] Checking autorecoverable hosts done >2012-08-07 09:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) [3fa5778d] Checking autorecoverable storage domains >2012-08-07 09:45:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) [3fa5778d] Autorecovering 1 storage domains >2012-08-07 09:45:00,025 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) [3fa5778d] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 09:45:00,027 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-85) [18c9084a] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:45:00,089 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-85) [18c9084a] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 09:45:00,145 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-85) [18c9084a] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:45:00,146 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-85) [18c9084a] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 9:45 AM >2012-08-07 09:45:00,166 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [18c9084a] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 3c77f0a2 >2012-08-07 09:48:00,170 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [18c9084a] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 09:48:00,171 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [18c9084a] FINISH, ConnectStorageServerVDSCommand, log id: 3c77f0a2 >2012-08-07 09:48:00,172 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [18c9084a] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 09:48:00,200 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-85) [18c9084a] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 9:48 AM >2012-08-07 09:48:00,202 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-85) [18c9084a] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 69529270 >2012-08-07 09:48:00,457 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-85) [18c9084a] Failed in ActivateStorageDomainVDS method >2012-08-07 09:48:00,458 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-85) [18c9084a] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:48:00,459 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) [18c9084a] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:48:00,466 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-85) [18c9084a] FINISH, ActivateStorageDomainVDSCommand, log id: 69529270 >2012-08-07 09:48:00,469 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-85) [18c9084a] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:48:00,479 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-85) [18c9084a] Command [id=ac42a3fd-861d-4bc1-91c0-19d3becfdb5b]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 09:48:00,499 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) [18c9084a] Checking autorecoverable storage domains done >2012-08-07 09:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [4c220a92] Checking autorecoverable hosts >2012-08-07 09:50:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [4c220a92] Autorecovering 0 hosts >2012-08-07 09:50:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [4c220a92] Checking autorecoverable hosts done >2012-08-07 09:50:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [4c220a92] Checking autorecoverable storage domains >2012-08-07 09:50:00,044 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [4c220a92] Autorecovering 1 storage domains >2012-08-07 09:50:00,046 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [4c220a92] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 09:50:00,050 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [52b6f060] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:50:00,123 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [52b6f060] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 09:50:00,165 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [52b6f060] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:50:00,170 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [52b6f060] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 9:50 AM >2012-08-07 09:50:00,187 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [52b6f060] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 2a3ea816 >2012-08-07 09:51:20,377 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) [2749f438] XML RPC error in command GetStatsVDS ( Vds: purple-vds2 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 09:51:20,388 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-45) [2749f438] vds::refreshVdsStats Failed getVdsStats, vds = 4196a566-dee6-11e1-b66e-c35c5273fee7 : purple-vds2, error = VDSNetworkException: VDSNetworkException: >2012-08-07 09:51:20,454 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-45) [2749f438] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 4196a566-dee6-11e1-b66e-c35c5273fee7 : purple-vds2, VDS Network Error, continuing. >VDSNetworkException: >2012-08-07 09:51:27,939 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-48) [1ec825c9] XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 09:51:27,943 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-48) [45b24534] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-07 09:53:00,191 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [52b6f060] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 09:53:00,192 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [52b6f060] FINISH, ConnectStorageServerVDSCommand, log id: 2a3ea816 >2012-08-07 09:53:00,192 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [52b6f060] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 09:53:00,223 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [52b6f060] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 9:53 AM >2012-08-07 09:53:00,224 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-37) [52b6f060] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 54258b15 >2012-08-07 09:53:00,476 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-37) [52b6f060] Failed in ActivateStorageDomainVDS method >2012-08-07 09:53:00,477 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-37) [52b6f060] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:53:00,478 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-37) [52b6f060] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:53:00,485 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-37) [52b6f060] FINISH, ActivateStorageDomainVDSCommand, log id: 54258b15 >2012-08-07 09:53:00,488 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [52b6f060] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:53:00,497 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-37) [52b6f060] Command [id=b7be041a-eb3d-4e42-b112-c1d76996987a]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 09:53:00,543 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) [52b6f060] Checking autorecoverable storage domains done >2012-08-07 09:54:22,461 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-84) [75019685] XML RPC error in command GetCapabilitiesVDS ( Vds: purple-vds2 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 09:54:22,462 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-84) [75019685] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 4196a566-dee6-11e1-b66e-c35c5273fee7 : purple-vds2, VDS Network Error, continuing. >VDSNetworkException: >2012-08-07 09:54:27,990 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-48) [45b24534] IrsBroker::Failed::GetStoragePoolInfoVDS due to: TimeoutException: >2012-08-07 09:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) [4b41ef76] Checking autorecoverable hosts >2012-08-07 09:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) [4b41ef76] Autorecovering 0 hosts >2012-08-07 09:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) [4b41ef76] Checking autorecoverable hosts done >2012-08-07 09:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) [4b41ef76] Checking autorecoverable storage domains >2012-08-07 09:55:00,053 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) [4b41ef76] Autorecovering 1 storage domains >2012-08-07 09:55:00,061 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) [4b41ef76] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 09:55:00,068 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [635fe67c] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:55:00,120 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [635fe67c] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 09:55:00,136 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [635fe67c] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 09:55:00,141 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [635fe67c] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 9:55 AM >2012-08-07 09:55:00,157 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [635fe67c] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 12ede0b >2012-08-07 09:57:24,469 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) [52b6f060] XML RPC error in command GetCapabilitiesVDS ( Vds: purple-vds2 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 09:57:24,470 ERROR [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-37) [52b6f060] VDS::handleNetworkException Server failed to respond, vds_id = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds_name = purple-vds2, error = VDSNetworkException: >2012-08-07 09:57:24,490 INFO [org.ovirt.engine.core.bll.VdsEventListener] (pool-3-thread-48) [52b6f060] ResourceManager::vdsNotResponding entered for Host 4196a566-dee6-11e1-b66e-c35c5273fee7, purple-vds2 >2012-08-07 09:57:24,547 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [132b9512] START, SetVmStatusVDSCommand(vmId = 3ce0f220-6cb8-42d8-b922-7003c60ccdad, status = Unknown), log id: 5ef9d04b >2012-08-07 09:57:24,563 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [132b9512] FINISH, SetVmStatusVDSCommand, log id: 5ef9d04b >2012-08-07 09:57:24,648 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [132b9512] START, SetVmStatusVDSCommand(vmId = 6df57989-99a7-4ec9-8f7c-15f222064e61, status = Unknown), log id: 2b4d6be6 >2012-08-07 09:57:24,663 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [132b9512] FINISH, SetVmStatusVDSCommand, log id: 2b4d6be6 >2012-08-07 09:57:24,682 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [132b9512] START, SetVmStatusVDSCommand(vmId = 3c7c0453-5f05-4314-bdd4-eb4fd243f80a, status = Unknown), log id: 7a4e20ea >2012-08-07 09:57:24,707 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-48) [132b9512] FINISH, SetVmStatusVDSCommand, log id: 7a4e20ea >2012-08-07 09:57:24,737 INFO [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (pool-3-thread-48) [132b9512] Fence failed on vds purple-vds2 which is spm of pool efe20197-e0a7-49b8-beb4-19b1ed3f8c3f - moving pool to non operational >2012-08-07 09:57:24,743 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (pool-3-thread-48) [5488f122] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-07 09:57:24,816 ERROR [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (pool-3-thread-48) [5488f122] Failed to run Fence script on vds:purple-vds2, VMs moved to UnKnown instead. >2012-08-07 09:57:37,994 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) [39ead820] XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 09:58:00,160 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [635fe67c] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 09:58:00,161 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [635fe67c] FINISH, ConnectStorageServerVDSCommand, log id: 12ede0b >2012-08-07 09:58:00,162 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [635fe67c] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 09:58:00,187 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [635fe67c] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 9:58 AM >2012-08-07 09:58:00,188 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-79) [635fe67c] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 9e74098 >2012-08-07 09:58:00,458 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-79) [635fe67c] Failed in ActivateStorageDomainVDS method >2012-08-07 09:58:00,459 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-79) [635fe67c] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:58:00,462 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-79) [635fe67c] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:58:00,468 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-79) [635fe67c] FINISH, ActivateStorageDomainVDSCommand, log id: 9e74098 >2012-08-07 09:58:00,472 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [635fe67c] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 09:58:00,481 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [635fe67c] Command [id=5101bccd-9caf-41b4-aa75-8e998f05ab4c]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 09:58:00,519 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) [635fe67c] Checking autorecoverable storage domains done >2012-08-07 10:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [6c475743] Checking autorecoverable hosts >2012-08-07 10:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [6c475743] Autorecovering 0 hosts >2012-08-07 10:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [6c475743] Checking autorecoverable hosts done >2012-08-07 10:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [6c475743] Checking autorecoverable storage domains >2012-08-07 10:00:00,035 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [6c475743] Autorecovering 1 storage domains >2012-08-07 10:00:00,038 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [6c475743] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 10:00:00,042 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [57799c4c] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:00:00,089 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [57799c4c] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 10:00:00,137 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [57799c4c] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:00:00,138 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [57799c4c] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 10:00 AM >2012-08-07 10:00:00,153 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [57799c4c] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 6a71ae86 >2012-08-07 10:00:26,521 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) [1b38323f] XML RPC error in command GetCapabilitiesVDS ( Vds: purple-vds2 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 10:00:37,997 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-30) [39ead820] IrsBroker::Failed::GetStoragePoolInfoVDS due to: TimeoutException: >2012-08-07 10:03:00,158 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [57799c4c] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 10:03:00,159 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [57799c4c] FINISH, ConnectStorageServerVDSCommand, log id: 6a71ae86 >2012-08-07 10:03:00,160 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [57799c4c] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 10:03:00,190 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [57799c4c] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 10:03 AM >2012-08-07 10:03:00,191 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-54) [57799c4c] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 73b03e9d >2012-08-07 10:03:00,468 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-54) [57799c4c] Failed in ActivateStorageDomainVDS method >2012-08-07 10:03:00,469 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-54) [57799c4c] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:03:00,471 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-54) [57799c4c] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:03:00,478 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-54) [57799c4c] FINISH, ActivateStorageDomainVDSCommand, log id: 73b03e9d >2012-08-07 10:03:00,481 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [57799c4c] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:03:00,488 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-54) [57799c4c] Command [id=e0055714-5a56-46aa-8fb0-eca32f903139]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 10:03:00,506 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-54) [57799c4c] Checking autorecoverable storage domains done >2012-08-07 10:04:21,244 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-17) [36c23662] vm pool1-7 running in db and not running in vds - add to rerun treatment. vds purple-vds2 >2012-08-07 10:04:21,245 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-17) [36c23662] vm pool1-2 running in db and not running in vds - add to rerun treatment. vds purple-vds2 >2012-08-07 10:04:21,245 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-17) [36c23662] vm pool1-1 running in db and not running in vds - add to rerun treatment. vds purple-vds2 >2012-08-07 10:04:21,247 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-17) [36d82f3e] Running command: InitVdsOnUpCommand internal: true. >2012-08-07 10:04:21,328 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-17) [1af01c3d] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-07 10:04:21,331 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-17) [1af01c3d] START, ConnectStorageServerVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, storageType = NFS, connectionList = [{ id: f6121783-5d14-493d-a12e-9b31402f985b, connection: orion.qa.lab.tlv.redhat.com:/export/lesik };]), log id: 3782e82 >2012-08-07 10:04:21,575 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-17) [1af01c3d] FINISH, ConnectStorageServerVDSCommand, return: {f6121783-5d14-493d-a12e-9b31402f985b=0}, log id: 3782e82 >2012-08-07 10:04:21,576 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-17) [1af01c3d] Host purple-vds2 storage connection was succeeded >2012-08-07 10:04:21,596 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-17) [1af01c3d] START, ConnectStoragePoolVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, vds_spm_id = 1, masterDomainId = a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, masterVersion = 1), log id: e434c60 >2012-08-07 10:04:24,265 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-17) [1af01c3d] FINISH, ConnectStoragePoolVDSCommand, log id: e434c60 >2012-08-07 10:04:24,295 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-17) [1af01c3d] No string for UNASSIGNED type. Use default Log >2012-08-07 10:04:24,309 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) [1af01c3d] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-08-07 10:04:24,359 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-17) [2aa1a2c9] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-07 10:04:24,379 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-17) [2e490258] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-07 10:04:28,134 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-33) [7900944a] hostFromVds::selectedVds - purple-vds2, spmStatus Free, storage pool nfs31 >2012-08-07 10:04:28,158 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-33) [7900944a] SpmStatus on vds 4196a566-dee6-11e1-b66e-c35c5273fee7: Free >2012-08-07 10:04:28,181 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-33) [7900944a] starting spm on vds purple-vds2, storage pool nfs31, prevId 1, LVER 4 >2012-08-07 10:04:28,183 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) [7900944a] START, SpmStartVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, prevId=1, prevLVER=4, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4c802dd8 >2012-08-07 10:04:28,211 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) [7900944a] spmStart polling started: taskId = 30a23fd8-a812-46da-affc-b5dfbd56b966 >2012-08-07 10:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable hosts >2012-08-07 10:05:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Autorecovering 0 hosts >2012-08-07 10:05:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable hosts done >2012-08-07 10:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable storage domains >2012-08-07 10:05:00,043 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Autorecovering 1 storage domains >2012-08-07 10:05:00,043 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 10:05:00,045 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-39) [57821f1b] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:05:00,192 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-39) [57821f1b] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 10:05:00,224 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-39) [57821f1b] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:05:00,225 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-39) [57821f1b] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 10:05 AM >2012-08-07 10:05:00,245 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [57821f1b] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 466ad594 >2012-08-07 10:07:07,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) [7900944a] spmStart polling ended: taskId = 30a23fd8-a812-46da-affc-b5dfbd56b966 task status = finished >2012-08-07 10:07:07,122 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) [7900944a] spmStart polling ended. spm status: SPM >2012-08-07 10:07:07,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-33) [7900944a] START, HSMClearTaskVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, taskId=30a23fd8-a812-46da-affc-b5dfbd56b966), log id: 6c3e2ba0 >2012-08-07 10:07:07,144 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-33) [7900944a] FINISH, HSMClearTaskVDSCommand, log id: 6c3e2ba0 >2012-08-07 10:07:07,145 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) [7900944a] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@65a24ce4, log id: 4c802dd8 >2012-08-07 10:07:07,156 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-33) [7900944a] Initialize Irs proxy from vds: purple-vds2 >2012-08-07 10:07:07,192 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-40) [15d911a8] Attempting to get and stop tasks on storage pool nfs31 >2012-08-07 10:07:07,193 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-40) [15d911a8] START, SPMGetAllTasksInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 26854a55 >2012-08-07 10:07:07,265 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-40) [15d911a8] -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool efe20197-e0a7-49b8-beb4-19b1ed3f8c3f >2012-08-07 10:07:07,267 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-40) [15d911a8] START, HSMGetAllTasksInfoVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7), log id: 27c74b16 >2012-08-07 10:07:07,288 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-40) [15d911a8] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 27c74b16 >2012-08-07 10:07:07,288 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-40) [15d911a8] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 26854a55 >2012-08-07 10:07:07,289 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-40) [15d911a8] Discovered no tasks on Storage Pool nfs31 >2012-08-07 10:07:07,290 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-40) [15d911a8] START, SPMGetAllTasksInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: d12a5c1 >2012-08-07 10:07:07,290 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-40) [15d911a8] -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool efe20197-e0a7-49b8-beb4-19b1ed3f8c3f >2012-08-07 10:07:07,292 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-40) [15d911a8] START, HSMGetAllTasksInfoVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7), log id: 76482e61 >2012-08-07 10:07:07,312 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-40) [15d911a8] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 76482e61 >2012-08-07 10:07:07,313 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-40) [15d911a8] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: d12a5c1 >2012-08-07 10:07:07,313 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-40) [15d911a8] Discovered no tasks on Storage Pool nfs31 >2012-08-07 10:08:00,249 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [57821f1b] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 10:08:00,250 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [57821f1b] FINISH, ConnectStorageServerVDSCommand, log id: 466ad594 >2012-08-07 10:08:00,251 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [57821f1b] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 10:08:00,257 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-39) [57821f1b] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 10:08 AM >2012-08-07 10:08:00,258 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-39) [57821f1b] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 1e0ab54f >2012-08-07 10:08:00,526 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-39) [57821f1b] Failed in ActivateStorageDomainVDS method >2012-08-07 10:08:00,526 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-39) [57821f1b] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:08:00,527 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) [57821f1b] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:08:00,536 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-39) [57821f1b] FINISH, ActivateStorageDomainVDSCommand, log id: 1e0ab54f >2012-08-07 10:08:00,537 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-39) [57821f1b] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:08:00,544 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-39) [57821f1b] Command [id=392e622d-ed98-4315-97fa-fe75a7870903]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 10:08:00,561 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) [57821f1b] Checking autorecoverable storage domains done >2012-08-07 10:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [201cee8c] Checking autorecoverable hosts >2012-08-07 10:10:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [201cee8c] Autorecovering 0 hosts >2012-08-07 10:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [201cee8c] Checking autorecoverable hosts done >2012-08-07 10:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [201cee8c] Checking autorecoverable storage domains >2012-08-07 10:10:00,021 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [201cee8c] Autorecovering 1 storage domains >2012-08-07 10:10:00,022 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [201cee8c] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 10:10:00,023 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [13d53c8b] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:10:00,065 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [13d53c8b] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 10:10:00,084 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [13d53c8b] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:10:00,085 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [13d53c8b] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 10:10 AM >2012-08-07 10:10:00,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [13d53c8b] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 7541b549 >2012-08-07 10:13:00,101 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [13d53c8b] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 10:13:00,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [13d53c8b] FINISH, ConnectStorageServerVDSCommand, log id: 7541b549 >2012-08-07 10:13:00,103 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [13d53c8b] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 10:13:00,109 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [13d53c8b] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 10:13 AM >2012-08-07 10:13:00,110 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-81) [13d53c8b] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 71da0aa6 >2012-08-07 10:13:00,385 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-81) [13d53c8b] Failed in ActivateStorageDomainVDS method >2012-08-07 10:13:00,386 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-81) [13d53c8b] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:13:00,387 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-81) [13d53c8b] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:13:00,392 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-81) [13d53c8b] FINISH, ActivateStorageDomainVDSCommand, log id: 71da0aa6 >2012-08-07 10:13:00,392 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [13d53c8b] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:13:00,397 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [13d53c8b] Command [id=927ac271-a30e-458b-902e-7d103553d7a0]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 10:13:00,412 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [13d53c8b] Checking autorecoverable storage domains done >2012-08-07 10:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) [75019685] Checking autorecoverable hosts >2012-08-07 10:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) [75019685] Autorecovering 0 hosts >2012-08-07 10:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) [75019685] Checking autorecoverable hosts done >2012-08-07 10:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) [75019685] Checking autorecoverable storage domains >2012-08-07 10:15:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) [75019685] Autorecovering 1 storage domains >2012-08-07 10:15:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) [75019685] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 10:15:00,029 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-84) [5d0d5ed0] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:15:00,080 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-84) [5d0d5ed0] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 10:15:00,098 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-84) [5d0d5ed0] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:15:00,099 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-84) [5d0d5ed0] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 10:15 AM >2012-08-07 10:15:00,111 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [5d0d5ed0] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 283cd7ee >2012-08-07 10:18:00,114 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-46) [5d0d5ed0] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 10:18:00,115 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [5d0d5ed0] FINISH, ConnectStorageServerVDSCommand, log id: 283cd7ee >2012-08-07 10:18:00,116 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-46) [5d0d5ed0] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 10:18:00,122 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-84) [5d0d5ed0] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 10:18 AM >2012-08-07 10:18:00,123 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-84) [5d0d5ed0] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 4ca1a1e5 >2012-08-07 10:18:00,374 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-84) [5d0d5ed0] Failed in ActivateStorageDomainVDS method >2012-08-07 10:18:00,374 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-84) [5d0d5ed0] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:18:00,375 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) [5d0d5ed0] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:18:00,380 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-84) [5d0d5ed0] FINISH, ActivateStorageDomainVDSCommand, log id: 4ca1a1e5 >2012-08-07 10:18:00,381 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-84) [5d0d5ed0] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:18:00,384 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-84) [5d0d5ed0] Command [id=99ea0cc0-189b-44e1-8367-42fb7fa6745a]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 10:18:00,401 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) [5d0d5ed0] Checking autorecoverable storage domains done >2012-08-07 10:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) [b706b45] Checking autorecoverable hosts >2012-08-07 10:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) [b706b45] Autorecovering 0 hosts >2012-08-07 10:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) [b706b45] Checking autorecoverable hosts done >2012-08-07 10:20:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) [b706b45] Checking autorecoverable storage domains >2012-08-07 10:20:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) [b706b45] Autorecovering 1 storage domains >2012-08-07 10:20:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) [b706b45] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 10:20:00,033 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-68) [70f2d454] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:20:00,083 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-68) [70f2d454] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 10:20:00,101 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-68) [70f2d454] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:20:00,101 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-68) [70f2d454] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 10:20 AM >2012-08-07 10:20:00,135 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [70f2d454] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 2416c36 >2012-08-07 10:23:00,138 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [70f2d454] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 10:23:00,140 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [70f2d454] FINISH, ConnectStorageServerVDSCommand, log id: 2416c36 >2012-08-07 10:23:00,142 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [70f2d454] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 10:23:00,151 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-68) [70f2d454] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 10:23 AM >2012-08-07 10:23:00,152 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-68) [70f2d454] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 2a00cc10 >2012-08-07 10:23:00,426 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-68) [70f2d454] Failed in ActivateStorageDomainVDS method >2012-08-07 10:23:00,427 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-68) [70f2d454] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:23:00,429 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-68) [70f2d454] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:23:00,434 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-68) [70f2d454] FINISH, ActivateStorageDomainVDSCommand, log id: 2a00cc10 >2012-08-07 10:23:00,435 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-68) [70f2d454] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:23:00,439 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-68) [70f2d454] Command [id=f93d4e44-7070-42f6-9e41-1ffdbc97b335]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 10:23:00,453 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) [70f2d454] Checking autorecoverable storage domains done >2012-08-07 10:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [325bc630] Checking autorecoverable hosts >2012-08-07 10:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [325bc630] Autorecovering 0 hosts >2012-08-07 10:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [325bc630] Checking autorecoverable hosts done >2012-08-07 10:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [325bc630] Checking autorecoverable storage domains >2012-08-07 10:25:00,062 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [325bc630] Autorecovering 1 storage domains >2012-08-07 10:25:00,062 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [325bc630] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 10:25:00,064 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [60193d92] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:25:00,119 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [60193d92] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 10:25:00,154 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [60193d92] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:25:00,155 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [60193d92] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 10:25 AM >2012-08-07 10:25:00,171 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [60193d92] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 7b9d8a61 >2012-08-07 10:28:00,173 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-46) [60193d92] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 10:28:00,174 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [60193d92] FINISH, ConnectStorageServerVDSCommand, log id: 7b9d8a61 >2012-08-07 10:28:00,175 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-46) [60193d92] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 10:28:00,181 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [60193d92] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 10:28 AM >2012-08-07 10:28:00,182 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-26) [60193d92] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 5f1416c2 >2012-08-07 10:28:00,434 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-26) [60193d92] Failed in ActivateStorageDomainVDS method >2012-08-07 10:28:00,436 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-26) [60193d92] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:28:00,437 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) [60193d92] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:28:00,439 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-26) [60193d92] FINISH, ActivateStorageDomainVDSCommand, log id: 5f1416c2 >2012-08-07 10:28:00,440 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [60193d92] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:28:00,444 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [60193d92] Command [id=e61193e0-8102-4ba9-a71a-80f58bf133cf]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 10:28:00,465 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [60193d92] Checking autorecoverable storage domains done >2012-08-07 10:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) [482d5e66] Checking autorecoverable hosts >2012-08-07 10:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) [482d5e66] Autorecovering 0 hosts >2012-08-07 10:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) [482d5e66] Checking autorecoverable hosts done >2012-08-07 10:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) [482d5e66] Checking autorecoverable storage domains >2012-08-07 10:30:00,045 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) [482d5e66] Autorecovering 1 storage domains >2012-08-07 10:30:00,046 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) [482d5e66] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 10:30:00,047 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [289e28c8] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:30:00,086 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [289e28c8] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 10:30:00,112 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [289e28c8] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:30:00,113 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [289e28c8] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 10:30 AM >2012-08-07 10:30:00,137 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [289e28c8] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 176902ea >2012-08-07 10:33:00,140 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-46) [289e28c8] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 10:33:00,141 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [289e28c8] FINISH, ConnectStorageServerVDSCommand, log id: 176902ea >2012-08-07 10:33:00,141 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-46) [289e28c8] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 10:33:00,151 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [289e28c8] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 10:33 AM >2012-08-07 10:33:00,152 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-9) [289e28c8] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 46cd4ee9 >2012-08-07 10:33:00,480 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-9) [289e28c8] Failed in ActivateStorageDomainVDS method >2012-08-07 10:33:00,481 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-9) [289e28c8] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:33:00,482 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-9) [289e28c8] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:33:00,486 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-9) [289e28c8] FINISH, ActivateStorageDomainVDSCommand, log id: 46cd4ee9 >2012-08-07 10:33:00,487 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [289e28c8] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:33:00,491 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [289e28c8] Command [id=57f129f3-49c2-4887-a24f-6b862d02037f]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 10:33:00,530 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) [289e28c8] Checking autorecoverable storage domains done >2012-08-07 10:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [477c33be] Checking autorecoverable hosts >2012-08-07 10:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [477c33be] Autorecovering 0 hosts >2012-08-07 10:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [477c33be] Checking autorecoverable hosts done >2012-08-07 10:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [477c33be] Checking autorecoverable storage domains >2012-08-07 10:35:00,074 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [477c33be] Autorecovering 1 storage domains >2012-08-07 10:35:00,074 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [477c33be] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 10:35:00,076 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-73) [614f276] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:35:00,128 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-73) [614f276] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 10:35:00,151 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-73) [614f276] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:35:00,152 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-73) [614f276] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 10:35 AM >2012-08-07 10:35:00,197 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [614f276] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 5cded30d >2012-08-07 10:38:00,200 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [614f276] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 10:38:00,201 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [614f276] FINISH, ConnectStorageServerVDSCommand, log id: 5cded30d >2012-08-07 10:38:00,202 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [614f276] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 10:38:00,208 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-73) [614f276] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 10:38 AM >2012-08-07 10:38:00,209 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-73) [614f276] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 2ccfc1f4 >2012-08-07 10:38:00,481 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-73) [614f276] Failed in ActivateStorageDomainVDS method >2012-08-07 10:38:00,482 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-73) [614f276] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:38:00,483 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) [614f276] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:38:00,485 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-73) [614f276] FINISH, ActivateStorageDomainVDSCommand, log id: 2ccfc1f4 >2012-08-07 10:38:00,485 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-73) [614f276] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:38:00,490 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-73) [614f276] Command [id=e57a335d-8e85-427c-8bfd-59b18ae9d729]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 10:38:00,510 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [614f276] Checking autorecoverable storage domains done >2012-08-07 10:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) [3361e47d] Checking autorecoverable hosts >2012-08-07 10:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) [3361e47d] Autorecovering 0 hosts >2012-08-07 10:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) [3361e47d] Checking autorecoverable hosts done >2012-08-07 10:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) [3361e47d] Checking autorecoverable storage domains >2012-08-07 10:40:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) [3361e47d] Autorecovering 1 storage domains >2012-08-07 10:40:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) [3361e47d] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 10:40:00,031 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [2a04b8e] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:40:00,076 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [2a04b8e] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 10:40:00,089 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [2a04b8e] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:40:00,090 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [2a04b8e] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 10:40 AM >2012-08-07 10:40:00,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [2a04b8e] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 4c830414 >2012-08-07 10:43:00,106 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [2a04b8e] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 10:43:00,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [2a04b8e] FINISH, ConnectStorageServerVDSCommand, log id: 4c830414 >2012-08-07 10:43:00,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [2a04b8e] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 10:43:00,114 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [2a04b8e] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 10:43 AM >2012-08-07 10:43:00,115 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-96) [2a04b8e] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 39b1ed9e >2012-08-07 10:43:00,366 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-96) [2a04b8e] Failed in ActivateStorageDomainVDS method >2012-08-07 10:43:00,367 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-96) [2a04b8e] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:43:00,368 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) [2a04b8e] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:43:00,370 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-96) [2a04b8e] FINISH, ActivateStorageDomainVDSCommand, log id: 39b1ed9e >2012-08-07 10:43:00,370 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [2a04b8e] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:43:00,374 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [2a04b8e] Command [id=8534d8e2-8a41-41a9-a11d-55f9bb614810]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 10:43:00,456 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) [2a04b8e] Checking autorecoverable storage domains done >2012-08-07 10:43:07,347 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-2) [7a828a84] DbUserCacheManager::refreshAllUserData() - entered >2012-08-07 10:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) [70f2d454] Checking autorecoverable hosts >2012-08-07 10:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) [70f2d454] Autorecovering 0 hosts >2012-08-07 10:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) [70f2d454] Checking autorecoverable hosts done >2012-08-07 10:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) [70f2d454] Checking autorecoverable storage domains >2012-08-07 10:45:00,042 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) [70f2d454] Autorecovering 1 storage domains >2012-08-07 10:45:00,043 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) [70f2d454] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 10:45:00,045 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-68) [839b1e3] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:45:00,075 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-68) [839b1e3] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 10:45:00,099 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-68) [839b1e3] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:45:00,100 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-68) [839b1e3] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 10:45 AM >2012-08-07 10:45:00,113 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [839b1e3] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 1596fa33 >2012-08-07 10:48:00,116 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-46) [839b1e3] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 10:48:00,117 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [839b1e3] FINISH, ConnectStorageServerVDSCommand, log id: 1596fa33 >2012-08-07 10:48:00,118 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-46) [839b1e3] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 10:48:00,124 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-68) [839b1e3] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 10:48 AM >2012-08-07 10:48:00,125 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-68) [839b1e3] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 11632919 >2012-08-07 10:48:00,381 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-68) [839b1e3] Failed in ActivateStorageDomainVDS method >2012-08-07 10:48:00,382 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-68) [839b1e3] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:48:00,383 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-68) [839b1e3] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:48:00,388 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-68) [839b1e3] FINISH, ActivateStorageDomainVDSCommand, log id: 11632919 >2012-08-07 10:48:00,389 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-68) [839b1e3] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:48:00,407 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-68) [839b1e3] Command [id=e73054f6-1949-437c-8faf-220fe5261010]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 10:48:00,426 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) [839b1e3] Checking autorecoverable storage domains done >2012-08-07 10:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) [57821f1b] Checking autorecoverable hosts >2012-08-07 10:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) [57821f1b] Autorecovering 0 hosts >2012-08-07 10:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) [57821f1b] Checking autorecoverable hosts done >2012-08-07 10:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) [57821f1b] Checking autorecoverable storage domains >2012-08-07 10:50:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) [57821f1b] Autorecovering 1 storage domains >2012-08-07 10:50:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) [57821f1b] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 10:50:00,021 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-39) [6a1b3cc1] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:50:00,074 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-39) [6a1b3cc1] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 10:50:00,091 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-39) [6a1b3cc1] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:50:00,091 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-39) [6a1b3cc1] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 10:50 AM >2012-08-07 10:50:00,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [6a1b3cc1] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 7fa977f4 >2012-08-07 10:53:00,107 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [6a1b3cc1] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 10:53:00,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [6a1b3cc1] FINISH, ConnectStorageServerVDSCommand, log id: 7fa977f4 >2012-08-07 10:53:00,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [6a1b3cc1] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 10:53:00,115 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-39) [6a1b3cc1] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 10:53 AM >2012-08-07 10:53:00,116 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-39) [6a1b3cc1] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 70de89c5 >2012-08-07 10:53:00,383 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-39) [6a1b3cc1] Failed in ActivateStorageDomainVDS method >2012-08-07 10:53:00,383 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-39) [6a1b3cc1] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:53:00,384 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) [6a1b3cc1] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:53:00,387 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-39) [6a1b3cc1] FINISH, ActivateStorageDomainVDSCommand, log id: 70de89c5 >2012-08-07 10:53:00,387 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-39) [6a1b3cc1] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:53:00,396 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-39) [6a1b3cc1] Command [id=6644ffdc-5ef2-42dd-9d3c-32766dcca882]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 10:53:00,418 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) [6a1b3cc1] Checking autorecoverable storage domains done >2012-08-07 10:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [13d53c8b] Checking autorecoverable hosts >2012-08-07 10:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [13d53c8b] Autorecovering 0 hosts >2012-08-07 10:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [13d53c8b] Checking autorecoverable hosts done >2012-08-07 10:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [13d53c8b] Checking autorecoverable storage domains >2012-08-07 10:55:00,052 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [13d53c8b] Autorecovering 1 storage domains >2012-08-07 10:55:00,052 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [13d53c8b] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 10:55:00,054 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [10f559b8] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:55:00,093 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [10f559b8] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 10:55:00,112 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [10f559b8] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 10:55:00,113 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [10f559b8] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 10:55 AM >2012-08-07 10:55:00,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [10f559b8] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 26f66a42 >2012-08-07 10:58:00,129 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [10f559b8] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 10:58:00,130 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [10f559b8] FINISH, ConnectStorageServerVDSCommand, log id: 26f66a42 >2012-08-07 10:58:00,130 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [10f559b8] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 10:58:00,137 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [10f559b8] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 10:58 AM >2012-08-07 10:58:00,138 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-81) [10f559b8] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 7e0d6be7 >2012-08-07 10:58:00,389 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-81) [10f559b8] Failed in ActivateStorageDomainVDS method >2012-08-07 10:58:00,390 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-81) [10f559b8] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:58:00,391 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-81) [10f559b8] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:58:00,393 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-81) [10f559b8] FINISH, ActivateStorageDomainVDSCommand, log id: 7e0d6be7 >2012-08-07 10:58:00,394 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [10f559b8] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 10:58:00,398 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-81) [10f559b8] Command [id=36a1f364-249c-40df-8079-85d2798021cd]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 10:58:00,410 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [10f559b8] Checking autorecoverable storage domains done >2012-08-07 11:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) [46fdd2e7] Checking autorecoverable hosts >2012-08-07 11:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) [46fdd2e7] Autorecovering 0 hosts >2012-08-07 11:00:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) [46fdd2e7] Checking autorecoverable hosts done >2012-08-07 11:00:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) [46fdd2e7] Checking autorecoverable storage domains >2012-08-07 11:00:00,113 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) [46fdd2e7] Autorecovering 1 storage domains >2012-08-07 11:00:00,114 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) [46fdd2e7] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 11:00:00,116 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-65) [4b9419b8] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:00:00,210 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-65) [4b9419b8] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 11:00:00,233 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-65) [4b9419b8] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:00:00,234 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-65) [4b9419b8] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 11:00 AM >2012-08-07 11:00:00,250 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [4b9419b8] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 49710117 >2012-08-07 11:03:00,254 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [4b9419b8] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 11:03:00,255 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [4b9419b8] FINISH, ConnectStorageServerVDSCommand, log id: 49710117 >2012-08-07 11:03:00,256 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [4b9419b8] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 11:03:00,267 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-65) [4b9419b8] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 11:03 AM >2012-08-07 11:03:00,268 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-65) [4b9419b8] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 48001734 >2012-08-07 11:03:00,552 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-65) [4b9419b8] Failed in ActivateStorageDomainVDS method >2012-08-07 11:03:00,553 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-65) [4b9419b8] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:03:00,554 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [4b9419b8] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:03:00,556 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-65) [4b9419b8] FINISH, ActivateStorageDomainVDSCommand, log id: 48001734 >2012-08-07 11:03:00,556 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-65) [4b9419b8] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:03:00,565 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-65) [4b9419b8] Command [id=f53b070c-26f5-47ae-883d-4bcf94eecce6]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 11:03:00,602 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) [4b9419b8] Checking autorecoverable storage domains done >2012-08-07 11:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) [1b38323f] Checking autorecoverable hosts >2012-08-07 11:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) [1b38323f] Autorecovering 0 hosts >2012-08-07 11:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) [1b38323f] Checking autorecoverable hosts done >2012-08-07 11:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) [1b38323f] Checking autorecoverable storage domains >2012-08-07 11:05:00,059 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) [1b38323f] Autorecovering 1 storage domains >2012-08-07 11:05:00,059 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) [1b38323f] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 11:05:00,061 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-97) [27f1c35] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:05:00,133 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-97) [27f1c35] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 11:05:00,158 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-97) [27f1c35] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:05:00,158 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-97) [27f1c35] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 11:05 AM >2012-08-07 11:05:00,180 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [27f1c35] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 3b86c66b >2012-08-07 11:08:00,183 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-46) [27f1c35] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 11:08:00,184 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [27f1c35] FINISH, ConnectStorageServerVDSCommand, log id: 3b86c66b >2012-08-07 11:08:00,189 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-46) [27f1c35] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 11:08:00,203 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-97) [27f1c35] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 11:08 AM >2012-08-07 11:08:00,204 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-97) [27f1c35] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 5f59c45b >2012-08-07 11:08:00,463 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-97) [27f1c35] Failed in ActivateStorageDomainVDS method >2012-08-07 11:08:00,463 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-97) [27f1c35] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:08:00,464 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) [27f1c35] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:08:00,467 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-97) [27f1c35] FINISH, ActivateStorageDomainVDSCommand, log id: 5f59c45b >2012-08-07 11:08:00,468 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-97) [27f1c35] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:08:00,471 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-97) [27f1c35] Command [id=c948441c-bebb-4246-81a2-de0fc0f6e0f2]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 11:08:00,486 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) [27f1c35] Checking autorecoverable storage domains done >2012-08-07 11:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [3cdb2ef] Checking autorecoverable hosts >2012-08-07 11:10:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [3cdb2ef] Autorecovering 0 hosts >2012-08-07 11:10:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [3cdb2ef] Checking autorecoverable hosts done >2012-08-07 11:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [3cdb2ef] Checking autorecoverable storage domains >2012-08-07 11:10:00,060 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [3cdb2ef] Autorecovering 1 storage domains >2012-08-07 11:10:00,061 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [3cdb2ef] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 11:10:00,063 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [7c3e7df2] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:10:00,100 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [7c3e7df2] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 11:10:00,122 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [7c3e7df2] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:10:00,123 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [7c3e7df2] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 11:10 AM >2012-08-07 11:10:00,137 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [7c3e7df2] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 35404f93 >2012-08-07 11:13:00,140 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [7c3e7df2] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 11:13:00,141 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [7c3e7df2] FINISH, ConnectStorageServerVDSCommand, log id: 35404f93 >2012-08-07 11:13:00,142 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [7c3e7df2] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 11:13:00,158 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [7c3e7df2] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 11:13 AM >2012-08-07 11:13:00,159 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-41) [7c3e7df2] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 7662bea0 >2012-08-07 11:13:00,421 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-41) [7c3e7df2] Failed in ActivateStorageDomainVDS method >2012-08-07 11:13:00,422 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-41) [7c3e7df2] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:13:00,423 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) [7c3e7df2] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:13:00,426 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-41) [7c3e7df2] FINISH, ActivateStorageDomainVDSCommand, log id: 7662bea0 >2012-08-07 11:13:00,427 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [7c3e7df2] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:13:00,431 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-41) [7c3e7df2] Command [id=65fcb8f7-8857-4c63-ae46-633458d7d6eb]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 11:13:00,472 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) [7c3e7df2] Checking autorecoverable storage domains done >2012-08-07 11:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) [167565ab] Checking autorecoverable hosts >2012-08-07 11:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) [167565ab] Autorecovering 0 hosts >2012-08-07 11:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) [167565ab] Checking autorecoverable hosts done >2012-08-07 11:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) [167565ab] Checking autorecoverable storage domains >2012-08-07 11:15:00,060 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) [167565ab] Autorecovering 1 storage domains >2012-08-07 11:15:00,060 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) [167565ab] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 11:15:00,067 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [140f16de] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:15:00,169 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [140f16de] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 11:15:00,191 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [140f16de] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:15:00,192 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [140f16de] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 11:15 AM >2012-08-07 11:15:00,207 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [140f16de] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 3da928a5 >2012-08-07 11:18:00,213 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [140f16de] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 11:18:00,214 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [140f16de] FINISH, ConnectStorageServerVDSCommand, log id: 3da928a5 >2012-08-07 11:18:00,215 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [140f16de] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 11:18:00,221 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [140f16de] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 11:18 AM >2012-08-07 11:18:00,221 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-74) [140f16de] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 19833736 >2012-08-07 11:18:00,472 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-74) [140f16de] Failed in ActivateStorageDomainVDS method >2012-08-07 11:18:00,473 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-74) [140f16de] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:18:00,474 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [140f16de] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:18:00,476 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-74) [140f16de] FINISH, ActivateStorageDomainVDSCommand, log id: 19833736 >2012-08-07 11:18:00,477 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [140f16de] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:18:00,480 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [140f16de] Command [id=346cc4e6-ae4d-4bcf-9138-a0e294e2ccd5]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 11:18:00,497 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) [140f16de] Checking autorecoverable storage domains done >2012-08-07 11:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [6342785a] Checking autorecoverable hosts >2012-08-07 11:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [6342785a] Autorecovering 0 hosts >2012-08-07 11:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [6342785a] Checking autorecoverable hosts done >2012-08-07 11:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [6342785a] Checking autorecoverable storage domains >2012-08-07 11:20:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [6342785a] Autorecovering 1 storage domains >2012-08-07 11:20:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [6342785a] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 11:20:00,021 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [74bde4f8] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:20:00,086 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [74bde4f8] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 11:20:00,108 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [74bde4f8] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:20:00,109 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [74bde4f8] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 11:20 AM >2012-08-07 11:20:00,137 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [74bde4f8] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 7fb69237 >2012-08-07 11:23:00,143 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [74bde4f8] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 11:23:00,144 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [74bde4f8] FINISH, ConnectStorageServerVDSCommand, log id: 7fb69237 >2012-08-07 11:23:00,145 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [74bde4f8] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 11:23:00,151 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [74bde4f8] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 11:23 AM >2012-08-07 11:23:00,152 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-55) [74bde4f8] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 647becec >2012-08-07 11:23:00,402 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-55) [74bde4f8] Failed in ActivateStorageDomainVDS method >2012-08-07 11:23:00,403 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-55) [74bde4f8] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:23:00,404 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-55) [74bde4f8] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:23:00,427 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-55) [74bde4f8] FINISH, ActivateStorageDomainVDSCommand, log id: 647becec >2012-08-07 11:23:00,428 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [74bde4f8] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:23:00,436 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [74bde4f8] Command [id=47db8361-b820-4d42-81b3-b0ca2c7ae582]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 11:23:00,455 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [74bde4f8] Checking autorecoverable storage domains done >2012-08-07 11:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [76a53ad2] Checking autorecoverable hosts >2012-08-07 11:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [76a53ad2] Autorecovering 0 hosts >2012-08-07 11:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [76a53ad2] Checking autorecoverable hosts done >2012-08-07 11:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [76a53ad2] Checking autorecoverable storage domains >2012-08-07 11:25:00,057 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [76a53ad2] Autorecovering 1 storage domains >2012-08-07 11:25:00,057 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [76a53ad2] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 11:25:00,059 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [7a15b72] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:25:00,128 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [7a15b72] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 11:25:00,152 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [7a15b72] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:25:00,153 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [7a15b72] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 11:25 AM >2012-08-07 11:25:00,167 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [7a15b72] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 196e1029 >2012-08-07 11:28:00,170 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [7a15b72] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 11:28:00,170 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [7a15b72] FINISH, ConnectStorageServerVDSCommand, log id: 196e1029 >2012-08-07 11:28:00,171 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [7a15b72] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 11:28:00,177 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [7a15b72] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 11:28 AM >2012-08-07 11:28:00,178 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-72) [7a15b72] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 3c114c03 >2012-08-07 11:28:00,430 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-72) [7a15b72] Failed in ActivateStorageDomainVDS method >2012-08-07 11:28:00,431 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-72) [7a15b72] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:28:00,432 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-72) [7a15b72] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:28:00,435 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-72) [7a15b72] FINISH, ActivateStorageDomainVDSCommand, log id: 3c114c03 >2012-08-07 11:28:00,436 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [7a15b72] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:28:00,439 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-72) [7a15b72] Command [id=f06177c0-f20b-4595-ad8a-3667f95d257a]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 11:28:00,454 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [7a15b72] Checking autorecoverable storage domains done >2012-08-07 11:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Checking autorecoverable hosts >2012-08-07 11:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Autorecovering 0 hosts >2012-08-07 11:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Checking autorecoverable hosts done >2012-08-07 11:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Checking autorecoverable storage domains >2012-08-07 11:30:00,044 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Autorecovering 1 storage domains >2012-08-07 11:30:00,044 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 11:30:00,045 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-95) [441b17e2] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:30:00,088 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-95) [441b17e2] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 11:30:00,113 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-95) [441b17e2] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:30:00,114 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-95) [441b17e2] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 11:30 AM >2012-08-07 11:30:00,127 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [441b17e2] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 2014da06 >2012-08-07 11:33:00,130 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [441b17e2] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 11:33:00,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [441b17e2] FINISH, ConnectStorageServerVDSCommand, log id: 2014da06 >2012-08-07 11:33:00,132 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [441b17e2] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 11:33:00,138 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-95) [441b17e2] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 11:33 AM >2012-08-07 11:33:00,139 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-95) [441b17e2] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 5c963e14 >2012-08-07 11:33:00,392 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-95) [441b17e2] Failed in ActivateStorageDomainVDS method >2012-08-07 11:33:00,393 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-95) [441b17e2] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:33:00,394 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-95) [441b17e2] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:33:00,396 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-95) [441b17e2] FINISH, ActivateStorageDomainVDSCommand, log id: 5c963e14 >2012-08-07 11:33:00,397 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-95) [441b17e2] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:33:00,400 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-95) [441b17e2] Command [id=adb04c1a-b6a4-41d2-9160-bdabfef43c00]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 11:33:00,430 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) [441b17e2] Checking autorecoverable storage domains done >2012-08-07 11:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) [15d911a8] Checking autorecoverable hosts >2012-08-07 11:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) [15d911a8] Autorecovering 0 hosts >2012-08-07 11:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) [15d911a8] Checking autorecoverable hosts done >2012-08-07 11:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) [15d911a8] Checking autorecoverable storage domains >2012-08-07 11:35:00,036 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) [15d911a8] Autorecovering 1 storage domains >2012-08-07 11:35:00,037 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) [15d911a8] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 11:35:00,038 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-40) [3fb9e396] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:35:00,113 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-40) [3fb9e396] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 11:35:00,132 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-40) [3fb9e396] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:35:00,132 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-40) [3fb9e396] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 11:35 AM >2012-08-07 11:35:00,150 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [3fb9e396] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 58676d36 >2012-08-07 11:38:00,153 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [3fb9e396] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 11:38:00,154 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [3fb9e396] FINISH, ConnectStorageServerVDSCommand, log id: 58676d36 >2012-08-07 11:38:00,155 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-48) [3fb9e396] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 11:38:00,162 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-40) [3fb9e396] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 11:38 AM >2012-08-07 11:38:00,163 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-40) [3fb9e396] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 6c5b8bcb >2012-08-07 11:38:00,412 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-40) [3fb9e396] Failed in ActivateStorageDomainVDS method >2012-08-07 11:38:00,413 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-40) [3fb9e396] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:38:00,414 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) [3fb9e396] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:38:00,416 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-40) [3fb9e396] FINISH, ActivateStorageDomainVDSCommand, log id: 6c5b8bcb >2012-08-07 11:38:00,417 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-40) [3fb9e396] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:38:00,421 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-40) [3fb9e396] Command [id=11213f67-c87e-453b-b86d-a6fdad5153ac]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 11:38:00,460 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) [3fb9e396] Checking autorecoverable storage domains done >2012-08-07 11:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [1f44175d] Checking autorecoverable hosts >2012-08-07 11:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [1f44175d] Autorecovering 0 hosts >2012-08-07 11:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [1f44175d] Checking autorecoverable hosts done >2012-08-07 11:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [1f44175d] Checking autorecoverable storage domains >2012-08-07 11:40:00,021 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [1f44175d] Autorecovering 1 storage domains >2012-08-07 11:40:00,021 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [1f44175d] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 11:40:00,023 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [1dff9b40] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:40:00,149 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [1dff9b40] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 11:40:00,179 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [1dff9b40] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:40:00,180 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [1dff9b40] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 11:40 AM >2012-08-07 11:40:00,195 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [1dff9b40] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 25f9fe9a >2012-08-07 11:43:00,198 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [1dff9b40] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 11:43:00,199 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [1dff9b40] FINISH, ConnectStorageServerVDSCommand, log id: 25f9fe9a >2012-08-07 11:43:00,200 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [1dff9b40] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 11:43:00,209 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [1dff9b40] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 11:43 AM >2012-08-07 11:43:00,210 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-93) [1dff9b40] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 39faa275 >2012-08-07 11:43:00,459 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-93) [1dff9b40] Failed in ActivateStorageDomainVDS method >2012-08-07 11:43:00,460 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-93) [1dff9b40] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:43:00,461 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) [1dff9b40] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:43:00,487 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-93) [1dff9b40] FINISH, ActivateStorageDomainVDSCommand, log id: 39faa275 >2012-08-07 11:43:00,488 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [1dff9b40] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:43:00,497 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-93) [1dff9b40] Command [id=4eac32f5-6f35-43aa-84d6-e5d1325697ed]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 11:43:00,520 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-93) [1dff9b40] Checking autorecoverable storage domains done >2012-08-07 11:43:07,351 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-94) [7bf5c72f] DbUserCacheManager::refreshAllUserData() - entered >2012-08-07 11:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [74bde4f8] Checking autorecoverable hosts >2012-08-07 11:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [74bde4f8] Autorecovering 0 hosts >2012-08-07 11:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [74bde4f8] Checking autorecoverable hosts done >2012-08-07 11:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [74bde4f8] Checking autorecoverable storage domains >2012-08-07 11:45:00,080 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [74bde4f8] Autorecovering 1 storage domains >2012-08-07 11:45:00,080 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [74bde4f8] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 11:45:00,085 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [3851d7c] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:45:00,129 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [3851d7c] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 11:45:00,146 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [3851d7c] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:45:00,147 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [3851d7c] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 11:45 AM >2012-08-07 11:45:00,160 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [3851d7c] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 48b70ef8 >2012-08-07 11:47:11,502 ERROR [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-11) USER_FAILED_TO_AUTHENTICATE : admin >2012-08-07 11:47:11,505 WARN [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-11) CanDoAction of action LoginAdminUser failed. Reasons:USER_FAILED_TO_AUTHENTICATE >2012-08-07 11:47:16,214 ERROR [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-3) USER_FAILED_TO_AUTHENTICATE : admin >2012-08-07 11:47:16,214 WARN [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-3) CanDoAction of action LoginAdminUser failed. Reasons:USER_FAILED_TO_AUTHENTICATE >2012-08-07 11:47:18,225 ERROR [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-23) USER_FAILED_TO_AUTHENTICATE : admin >2012-08-07 11:47:18,225 WARN [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-23) CanDoAction of action LoginAdminUser failed. Reasons:USER_FAILED_TO_AUTHENTICATE >2012-08-07 11:47:20,498 ERROR [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-22) USER_FAILED_TO_AUTHENTICATE : admin >2012-08-07 11:47:20,498 WARN [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-22) CanDoAction of action LoginAdminUser failed. Reasons:USER_FAILED_TO_AUTHENTICATE >2012-08-07 11:47:24,777 ERROR [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-25) USER_FAILED_TO_AUTHENTICATE : admin >2012-08-07 11:47:24,778 WARN [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-25) CanDoAction of action LoginAdminUser failed. Reasons:USER_FAILED_TO_AUTHENTICATE >2012-08-07 11:48:00,168 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [3851d7c] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 11:48:00,169 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [3851d7c] FINISH, ConnectStorageServerVDSCommand, log id: 48b70ef8 >2012-08-07 11:48:00,169 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [3851d7c] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 11:48:00,176 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [3851d7c] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 11:48 AM >2012-08-07 11:48:00,177 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-55) [3851d7c] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 195c6a4a >2012-08-07 11:48:00,434 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-55) [3851d7c] Failed in ActivateStorageDomainVDS method >2012-08-07 11:48:00,434 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-55) [3851d7c] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:48:00,435 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-55) [3851d7c] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:48:00,438 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-55) [3851d7c] FINISH, ActivateStorageDomainVDSCommand, log id: 195c6a4a >2012-08-07 11:48:00,438 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [3851d7c] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:48:00,447 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-55) [3851d7c] Command [id=2b3edc51-9a6b-4dfa-a71f-b0eb1738edd1]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 11:48:00,469 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-55) [3851d7c] Checking autorecoverable storage domains done >2012-08-07 11:49:01,256 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-26) Checking if user admin@internal is an admin, result true >2012-08-07 11:49:01,256 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-26) Running command: LoginAdminUserCommand internal: false. >2012-08-07 11:49:34,245 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) Start time: 8/7/12 11:49 AM. Start running CanDoAction for command number 1/10 (Command type: RunVm) >2012-08-07 11:49:34,246 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/7/12 11:49 AM. Start running CanDoAction for command number 2/10 (Command type: RunVm) >2012-08-07 11:49:34,249 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) Start time: 8/7/12 11:49 AM. Start running CanDoAction for command number 3/10 (Command type: RunVm) >2012-08-07 11:49:34,251 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/7/12 11:49 AM. Start running CanDoAction for command number 4/10 (Command type: RunVm) >2012-08-07 11:49:34,254 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) Start time: 8/7/12 11:49 AM. Start running CanDoAction for command number 5/10 (Command type: RunVm) >2012-08-07 11:49:34,256 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/7/12 11:49 AM. Start running CanDoAction for command number 6/10 (Command type: RunVm) >2012-08-07 11:49:34,257 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/7/12 11:49 AM. Start running CanDoAction for command number 7/10 (Command type: RunVm) >2012-08-07 11:49:34,258 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) Start time: 8/7/12 11:49 AM. Start running CanDoAction for command number 8/10 (Command type: RunVm) >2012-08-07 11:49:34,259 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/7/12 11:49 AM. Start running CanDoAction for command number 9/10 (Command type: RunVm) >2012-08-07 11:49:34,260 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-41) Start time: 8/7/12 11:49 AM. Start running CanDoAction for command number 10/10 (Command type: RunVm) >2012-08-07 11:49:34,409 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) Lock Acquired to object EngineLock [exclusiveLocks= key: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 value: VM >, sharedLocks= ] >2012-08-07 11:49:34,411 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-44) Lock Acquired to object EngineLock [exclusiveLocks= key: 3c7c0453-5f05-4314-bdd4-eb4fd243f80a value: VM >, sharedLocks= ] >2012-08-07 11:49:34,411 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-47) Lock Acquired to object EngineLock [exclusiveLocks= key: ba81adbe-b311-4aef-b6c1-5f84f0f3c94d value: VM >, sharedLocks= ] >2012-08-07 11:49:34,412 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) Lock Acquired to object EngineLock [exclusiveLocks= key: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 value: VM >, sharedLocks= ] >2012-08-07 11:49:34,483 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-43) Lock Acquired to object EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] >2012-08-07 11:49:34,499 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) Lock Acquired to object EngineLock [exclusiveLocks= key: e5a192f1-3f9d-48e1-a817-28f72815c646 value: VM >, sharedLocks= ] >2012-08-07 11:49:34,511 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) Lock Acquired to object EngineLock [exclusiveLocks= key: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 value: VM >, sharedLocks= ] >2012-08-07 11:49:34,517 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 54628a40 >2012-08-07 11:49:34,528 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) FINISH, IsValidVDSCommand, return: true, log id: 54628a40 >2012-08-07 11:49:34,559 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) Lock Acquired to object EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-07 11:49:34,612 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) Lock Acquired to object EngineLock [exclusiveLocks= key: 2842672f-6230-434f-8232-e88e71560092 value: VM >, sharedLocks= ] >2012-08-07 11:49:34,706 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-48) START, IsVmDuringInitiatingVDSCommand(vmId = 54b872c6-cefc-4a19-b48e-9bc1a09285f9), log id: 6bb7f736 >2012-08-07 11:49:34,706 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-48) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 6bb7f736 >2012-08-07 11:49:34,784 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) Lock Acquired to object EngineLock [exclusiveLocks= key: 6c1fcddf-86d6-4533-905b-abb11b775f5b value: VM >, sharedLocks= ] >2012-08-07 11:49:35,060 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 68b16302 >2012-08-07 11:49:35,490 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) FINISH, IsValidVDSCommand, return: true, log id: 68b16302 >2012-08-07 11:49:35,492 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-44) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 75f4bec0 >2012-08-07 11:49:35,493 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-47) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 66f2093a >2012-08-07 11:49:35,497 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) End time: 8/7/12 11:49 AM. Finish handling CanDoAction for command number 1/10 (Command type: RunVm) >2012-08-07 11:49:35,498 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-47) FINISH, IsValidVDSCommand, return: true, log id: 66f2093a >2012-08-07 11:49:35,500 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-44) FINISH, IsValidVDSCommand, return: true, log id: 75f4bec0 >2012-08-07 11:49:35,637 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-44) START, IsVmDuringInitiatingVDSCommand(vmId = 3c7c0453-5f05-4314-bdd4-eb4fd243f80a), log id: 411a2117 >2012-08-07 11:49:35,638 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) START, IsVmDuringInitiatingVDSCommand(vmId = 6a729fb0-47fe-4eba-9ba3-2b939eee2b19), log id: 56e29673 >2012-08-07 11:49:35,639 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 56e29673 >2012-08-07 11:49:35,641 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-44) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 411a2117 >2012-08-07 11:49:35,657 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/7/12 11:49 AM. Finish handling CanDoAction for command number 4/10 (Command type: RunVm) >2012-08-07 11:49:35,666 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-47) START, IsVmDuringInitiatingVDSCommand(vmId = ba81adbe-b311-4aef-b6c1-5f84f0f3c94d), log id: 36338af >2012-08-07 11:49:35,667 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-47) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 36338af >2012-08-07 11:49:35,725 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) End time: 8/7/12 11:49 AM. Finish handling CanDoAction for command number 3/10 (Command type: RunVm) >2012-08-07 11:49:35,818 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/7/12 11:49 AM. Finish handling CanDoAction for command number 2/10 (Command type: RunVm) >2012-08-07 11:49:36,051 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-41) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 710af6cd >2012-08-07 11:49:36,092 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 7b995044 >2012-08-07 11:49:36,096 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-41) FINISH, IsValidVDSCommand, return: true, log id: 710af6cd >2012-08-07 11:49:36,110 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 16e582f6 >2012-08-07 11:49:36,114 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 742cb437 >2012-08-07 11:49:36,136 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) FINISH, IsValidVDSCommand, return: true, log id: 7b995044 >2012-08-07 11:49:36,147 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 15157d45 >2012-08-07 11:49:36,150 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) FINISH, IsValidVDSCommand, return: true, log id: 16e582f6 >2012-08-07 11:49:36,163 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) FINISH, IsValidVDSCommand, return: true, log id: 742cb437 >2012-08-07 11:49:36,183 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) FINISH, IsValidVDSCommand, return: true, log id: 15157d45 >2012-08-07 11:49:36,225 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6c626b54 >2012-08-07 11:49:36,381 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) FINISH, IsValidVDSCommand, return: true, log id: 6c626b54 >2012-08-07 11:49:36,432 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-41) START, IsVmDuringInitiatingVDSCommand(vmId = 6df57989-99a7-4ec9-8f7c-15f222064e61), log id: 74f76c85 >2012-08-07 11:49:36,432 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-41) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 74f76c85 >2012-08-07 11:49:36,560 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-41) End time: 8/7/12 11:49 AM. Finish handling CanDoAction for command number 10/10 (Command type: RunVm) >2012-08-07 11:49:36,597 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) START, IsVmDuringInitiatingVDSCommand(vmId = e5a192f1-3f9d-48e1-a817-28f72815c646), log id: 696cdfa3 >2012-08-07 11:49:36,597 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 696cdfa3 >2012-08-07 11:49:36,686 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/7/12 11:49 AM. Finish handling CanDoAction for command number 6/10 (Command type: RunVm) >2012-08-07 11:49:36,702 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-43) START, IsVmDuringInitiatingVDSCommand(vmId = 5524b98a-aa45-49cb-9d8b-bec3884753c9), log id: 1dd6eeda >2012-08-07 11:49:36,702 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-43) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 1dd6eeda >2012-08-07 11:49:36,790 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/7/12 11:49 AM. Finish handling CanDoAction for command number 9/10 (Command type: RunVm) >2012-08-07 11:49:37,322 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) START, IsVmDuringInitiatingVDSCommand(vmId = 6c1fcddf-86d6-4533-905b-abb11b775f5b), log id: 2caa9f15 >2012-08-07 11:49:37,322 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 2caa9f15 >2012-08-07 11:49:37,379 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/7/12 11:49 AM. Finish handling CanDoAction for command number 7/10 (Command type: RunVm) >2012-08-07 11:49:37,425 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) START, IsVmDuringInitiatingVDSCommand(vmId = 9dbe6b1e-2a98-449e-8bd7-2d025c420a42), log id: 46ff6251 >2012-08-07 11:49:37,426 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 46ff6251 >2012-08-07 11:49:37,494 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) End time: 8/7/12 11:49 AM. Finish handling CanDoAction for command number 5/10 (Command type: RunVm) >2012-08-07 11:49:37,543 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-42) START, IsVmDuringInitiatingVDSCommand(vmId = 2842672f-6230-434f-8232-e88e71560092), log id: 67307305 >2012-08-07 11:49:37,544 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-42) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 67307305 >2012-08-07 11:49:37,650 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) End time: 8/7/12 11:49 AM. Finish handling CanDoAction for command number 8/10 (Command type: RunVm) >2012-08-07 11:49:37,651 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) Start time: 8/7/12 11:49 AM. Start running CanDoAction for command number 12/18 (Command type: RunVm) >2012-08-07 11:49:37,652 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/7/12 11:49 AM. Start running CanDoAction for command number 13/18 (Command type: RunVm) >2012-08-07 11:49:37,653 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/7/12 11:49 AM. Start running CanDoAction for command number 14/18 (Command type: RunVm) >2012-08-07 11:49:37,654 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/7/12 11:49 AM. Start running CanDoAction for command number 15/18 (Command type: RunVm) >2012-08-07 11:49:37,654 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-41) Start time: 8/7/12 11:49 AM. Start running CanDoAction for command number 16/18 (Command type: RunVm) >2012-08-07 11:49:37,655 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/7/12 11:49 AM. Start running CanDoAction for command number 17/18 (Command type: RunVm) >2012-08-07 11:49:37,656 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/7/12 11:49 AM. Start running CanDoAction for command number 18/18 (Command type: RunVm) >2012-08-07 11:49:37,665 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) Start time: 8/7/12 11:49 AM. Start running CanDoAction for command number 11/18 (Command type: RunVm) >2012-08-07 11:49:37,709 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-47) Lock Acquired to object EngineLock [exclusiveLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >, sharedLocks= ] >2012-08-07 11:49:37,734 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) Lock Acquired to object EngineLock [exclusiveLocks= key: 3ce0f220-6cb8-42d8-b922-7003c60ccdad value: VM >, sharedLocks= ] >2012-08-07 11:49:37,742 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) Lock Acquired to object EngineLock [exclusiveLocks= key: 8738bb81-c73e-4a41-a24a-c4c49491c536 value: VM >, sharedLocks= ] >2012-08-07 11:49:37,749 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) Lock Acquired to object EngineLock [exclusiveLocks= key: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 value: VM >, sharedLocks= ] >2012-08-07 11:49:37,753 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) Lock Acquired to object EngineLock [exclusiveLocks= key: d3c805a2-419c-480f-8627-f5c9ef5c4117 value: VM >, sharedLocks= ] >2012-08-07 11:49:37,754 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) Lock Acquired to object EngineLock [exclusiveLocks= key: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 value: VM >, sharedLocks= ] >2012-08-07 11:49:37,760 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-43) Lock Acquired to object EngineLock [exclusiveLocks= key: c7702cf0-88da-4885-9b9c-9e59772b3774 value: VM >, sharedLocks= ] >2012-08-07 11:49:37,766 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) Lock Acquired to object EngineLock [exclusiveLocks= key: c1cb365c-a119-493c-964c-faf65a10c889 value: VM >, sharedLocks= ] >2012-08-07 11:49:38,029 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-47) START, IsValidVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1c95d48 >2012-08-07 11:49:38,055 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-47) FINISH, IsValidVDSCommand, return: true, log id: 1c95d48 >2012-08-07 11:49:38,113 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 51d13933 >2012-08-07 11:49:38,115 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) FINISH, IsValidVDSCommand, return: true, log id: 51d13933 >2012-08-07 11:49:38,143 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 39133cad >2012-08-07 11:49:38,145 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 13f38942 >2012-08-07 11:49:38,148 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) FINISH, IsValidVDSCommand, return: true, log id: 13f38942 >2012-08-07 11:49:38,152 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) FINISH, IsValidVDSCommand, return: true, log id: 39133cad >2012-08-07 11:49:38,169 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-41) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 462530fc >2012-08-07 11:49:38,170 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-41) FINISH, IsValidVDSCommand, return: true, log id: 462530fc >2012-08-07 11:49:38,173 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 74f42158 >2012-08-07 11:49:38,175 WARN [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-47) CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,ACTION_TYPE_FAILED_STORAGE_DOMAIN_STATUS_ILLEGAL >2012-08-07 11:49:38,176 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-47) Lock freed to object EngineLock [exclusiveLocks= key: c6f4d0f1-f440-4096-90f5-cd57524d648d value: VM >, sharedLocks= ] >2012-08-07 11:49:38,177 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/7/12 11:49 AM. Finish handling CanDoAction for command number 18/18 (Command type: RunVm) >2012-08-07 11:49:38,186 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) FINISH, IsValidVDSCommand, return: true, log id: 74f42158 >2012-08-07 11:49:38,256 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-43) START, IsVmDuringInitiatingVDSCommand(vmId = c7702cf0-88da-4885-9b9c-9e59772b3774), log id: 57219e43 >2012-08-07 11:49:38,263 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-43) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 57219e43 >2012-08-07 11:49:38,274 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/7/12 11:49 AM. Finish handling CanDoAction for command number 14/18 (Command type: RunVm) >2012-08-07 11:49:38,277 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 367489e9 >2012-08-07 11:49:38,290 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) FINISH, IsValidVDSCommand, return: true, log id: 367489e9 >2012-08-07 11:49:38,468 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-41) START, IsVmDuringInitiatingVDSCommand(vmId = 96405d4a-a3bd-4900-ab90-9c8736cb02a5), log id: 68dec395 >2012-08-07 11:49:38,469 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-41) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 68dec395 >2012-08-07 11:49:38,478 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) START, IsVmDuringInitiatingVDSCommand(vmId = c1cb365c-a119-493c-964c-faf65a10c889), log id: 43ee6ebf >2012-08-07 11:49:38,482 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 43ee6ebf >2012-08-07 11:49:38,475 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) START, IsVmDuringInitiatingVDSCommand(vmId = 3ce0f220-6cb8-42d8-b922-7003c60ccdad), log id: 5f6d1aa >2012-08-07 11:49:38,485 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 5f6d1aa >2012-08-07 11:49:38,507 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/7/12 11:49 AM. Finish handling CanDoAction for command number 13/18 (Command type: RunVm) >2012-08-07 11:49:38,515 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/7/12 11:49 AM. Finish handling CanDoAction for command number 15/18 (Command type: RunVm) >2012-08-07 11:49:38,516 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-41) End time: 8/7/12 11:49 AM. Finish handling CanDoAction for command number 16/18 (Command type: RunVm) >2012-08-07 11:49:38,519 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 3b689384 >2012-08-07 11:49:38,538 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) FINISH, IsValidVDSCommand, return: true, log id: 3b689384 >2012-08-07 11:49:38,552 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) START, IsVmDuringInitiatingVDSCommand(vmId = 8738bb81-c73e-4a41-a24a-c4c49491c536), log id: 2b8a0e60 >2012-08-07 11:49:38,552 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 2b8a0e60 >2012-08-07 11:49:38,559 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/7/12 11:49 AM. Finish handling CanDoAction for command number 17/18 (Command type: RunVm) >2012-08-07 11:49:38,561 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) START, IsVmDuringInitiatingVDSCommand(vmId = a7d2a056-b67b-4bc5-b8ea-7afef2d2b861), log id: 1c2e287a >2012-08-07 11:49:38,561 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 1c2e287a >2012-08-07 11:49:38,570 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) End time: 8/7/12 11:49 AM. Finish handling CanDoAction for command number 12/18 (Command type: RunVm) >2012-08-07 11:49:38,728 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-42) START, IsVmDuringInitiatingVDSCommand(vmId = d3c805a2-419c-480f-8627-f5c9ef5c4117), log id: 72a2780a >2012-08-07 11:49:38,729 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-42) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 72a2780a >2012-08-07 11:49:38,802 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) End time: 8/7/12 11:49 AM. Finish handling CanDoAction for command number 11/18 (Command type: RunVm) >2012-08-07 11:49:38,974 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [239b79b1] Running command: RunVmCommand internal: false. Entities affected : ID: ba81adbe-b311-4aef-b6c1-5f84f0f3c94d Type: VM >2012-08-07 11:49:39,051 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [239b79b1] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=ba81adbe-b311-4aef-b6c1-5f84f0f3c94d, vm=org.ovirt.engine.core.common.businessentities.VM@58479c58), log id: d09382f >2012-08-07 11:49:39,059 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [239b79b1] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=ba81adbe-b311-4aef-b6c1-5f84f0f3c94d, vm=org.ovirt.engine.core.common.businessentities.VM@58479c58), log id: edf188a >2012-08-07 11:49:39,186 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [239b79b1] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=ba81adbe-b311-4aef-b6c1-5f84f0f3c94d,devices=[Ljava.util.Map;@342dd5a2,acpiEnable=true,vmName=new,cpuType=Conroe,custom={} >2012-08-07 11:49:39,187 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [239b79b1] FINISH, CreateVDSCommand, log id: edf188a >2012-08-07 11:49:39,205 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [239b79b1] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 1. Vm: new >2012-08-07 11:49:39,265 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [239b79b1] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: d09382f >2012-08-07 11:49:39,266 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [239b79b1] Lock freed to object EngineLock [exclusiveLocks= key: ba81adbe-b311-4aef-b6c1-5f84f0f3c94d value: VM >, sharedLocks= ] >2012-08-07 11:49:39,398 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [7e785411] Running command: RunVmCommand internal: false. Entities affected : ID: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 Type: VM >2012-08-07 11:49:39,512 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [7e785411] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=54b872c6-cefc-4a19-b48e-9bc1a09285f9, vm=org.ovirt.engine.core.common.businessentities.VM@6a1e99f6), log id: 6db492fe >2012-08-07 11:49:39,545 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [7e785411] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=54b872c6-cefc-4a19-b48e-9bc1a09285f9, vm=org.ovirt.engine.core.common.businessentities.VM@6a1e99f6), log id: 446494e7 >2012-08-07 11:49:39,632 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [7e785411] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=0,transparentHugePages=true,vmId=54b872c6-cefc-4a19-b48e-9bc1a09285f9,devices=[Ljava.util.Map;@2239596f,acpiEnable=true,vmName=lesik,cpuType=Conroe,custom={device_8e68a777-07c1-4fc7-a625-dc3ae7b33a81device_b5f0adca-088c-4e5c-889d-46c0bff2e183device_ded1b941-0aa3-4c7c-93dd-2e5f5fb517c5=VmId=54b872c6-cefc-4a19-b48e-9bc1a09285f9,DeviceId=ded1b941-0aa3-4c7c-93dd-2e5f5fb517c5,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_8e68a777-07c1-4fc7-a625-dc3ae7b33a81=VmId=54b872c6-cefc-4a19-b48e-9bc1a09285f9,DeviceId=8e68a777-07c1-4fc7-a625-dc3ae7b33a81,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_8e68a777-07c1-4fc7-a625-dc3ae7b33a81device_b5f0adca-088c-4e5c-889d-46c0bff2e183device_ded1b941-0aa3-4c7c-93dd-2e5f5fb517c5device_69685785-4afd-4484-bc31-8dd42e263b66device_9a6007a1-a8e6-4a71-bd49-81b81140ef14=VmId=54b872c6-cefc-4a19-b48e-9bc1a09285f9,DeviceId=9a6007a1-a8e6-4a71-bd49-81b81140ef14,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_8e68a777-07c1-4fc7-a625-dc3ae7b33a81device_b5f0adca-088c-4e5c-889d-46c0bff2e183device_ded1b941-0aa3-4c7c-93dd-2e5f5fb517c5device_69685785-4afd-4484-bc31-8dd42e263b66=VmId=54b872c6-cefc-4a19-b48e-9bc1a09285f9,DeviceId=69685785-4afd-4484-bc31-8dd42e263b66,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_8e68a777-07c1-4fc7-a625-dc3ae7b33a81device_b5f0adca-088c-4e5c-889d-46c0bff2e183=VmId=54b872c6-cefc-4a19-b48e-9bc1a09285f9,DeviceId=b5f0adca-088c-4e5c-889d-46c0bff2e183,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0} >2012-08-07 11:49:39,640 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [7e785411] FINISH, CreateVDSCommand, log id: 446494e7 >2012-08-07 11:49:39,647 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [7e785411] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 2. Vm: lesik >2012-08-07 11:49:39,696 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [7e785411] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 6db492fe >2012-08-07 11:49:39,697 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [7e785411] Lock freed to object EngineLock [exclusiveLocks= key: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 value: VM >, sharedLocks= ] >2012-08-07 11:49:39,771 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [1926bf80] Running command: RunVmCommand internal: false. Entities affected : ID: 8738bb81-c73e-4a41-a24a-c4c49491c536 Type: VM >2012-08-07 11:49:39,799 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [1926bf80] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=8738bb81-c73e-4a41-a24a-c4c49491c536, vm=org.ovirt.engine.core.common.businessentities.VM@1b4282d8), log id: 73bf67f6 >2012-08-07 11:49:39,802 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [1926bf80] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=8738bb81-c73e-4a41-a24a-c4c49491c536, vm=org.ovirt.engine.core.common.businessentities.VM@1b4282d8), log id: 10e77ebf >2012-08-07 11:49:39,849 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [1926bf80] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=8738bb81-c73e-4a41-a24a-c4c49491c536,devices=[Ljava.util.Map;@331614,acpiEnable=true,vmName=pool1-9,cpuType=Conroe,custom={} >2012-08-07 11:49:39,850 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [1926bf80] FINISH, CreateVDSCommand, log id: 10e77ebf >2012-08-07 11:49:39,863 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [1926bf80] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 3. Vm: pool1-9 >2012-08-07 11:49:39,931 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [1926bf80] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 73bf67f6 >2012-08-07 11:49:39,931 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [1926bf80] Lock freed to object EngineLock [exclusiveLocks= key: 8738bb81-c73e-4a41-a24a-c4c49491c536 value: VM >, sharedLocks= ] >2012-08-07 11:49:40,065 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [6ab6bac5] Running command: RunVmCommand internal: false. Entities affected : ID: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 Type: VM >2012-08-07 11:49:40,253 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [6ab6bac5] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, vm=org.ovirt.engine.core.common.businessentities.VM@53cbca2d), log id: de19059 >2012-08-07 11:49:40,260 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [6ab6bac5] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, vm=org.ovirt.engine.core.common.businessentities.VM@53cbca2d), log id: 219b596b >2012-08-07 11:49:40,311 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [6ab6bac5] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19,devices=[Ljava.util.Map;@635379f7,acpiEnable=true,vmName=pool1-10,cpuType=Conroe,custom={} >2012-08-07 11:49:40,313 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [6ab6bac5] FINISH, CreateVDSCommand, log id: 219b596b >2012-08-07 11:49:40,319 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [6ab6bac5] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 4. Vm: pool1-10 >2012-08-07 11:49:40,378 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [6ab6bac5] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: de19059 >2012-08-07 11:49:40,378 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [6ab6bac5] Lock freed to object EngineLock [exclusiveLocks= key: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 value: VM >, sharedLocks= ] >2012-08-07 11:49:40,445 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [10d3e09a] Running command: RunVmCommand internal: false. Entities affected : ID: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 Type: VM >2012-08-07 11:49:40,469 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [10d3e09a] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42, vm=org.ovirt.engine.core.common.businessentities.VM@6a42ae5b), log id: 2f29efdd >2012-08-07 11:49:40,473 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [10d3e09a] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42, vm=org.ovirt.engine.core.common.businessentities.VM@6a42ae5b), log id: 63660479 >2012-08-07 11:49:40,520 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [10d3e09a] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42,devices=[Ljava.util.Map;@446ff583,acpiEnable=true,vmName=pool1-11,cpuType=Conroe,custom={} >2012-08-07 11:49:40,521 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [10d3e09a] FINISH, CreateVDSCommand, log id: 63660479 >2012-08-07 11:49:40,527 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [10d3e09a] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 5. Vm: pool1-11 >2012-08-07 11:49:40,559 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [10d3e09a] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 2f29efdd >2012-08-07 11:49:40,560 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [10d3e09a] Lock freed to object EngineLock [exclusiveLocks= key: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 value: VM >, sharedLocks= ] >2012-08-07 11:49:40,703 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [679f8129] Running command: RunVmCommand internal: false. Entities affected : ID: e5a192f1-3f9d-48e1-a817-28f72815c646 Type: VM >2012-08-07 11:49:40,723 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-76) START, FullListVdsCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=null, vmIds=[8738bb81-c73e-4a41-a24a-c4c49491c536, 6a729fb0-47fe-4eba-9ba3-2b939eee2b19, ba81adbe-b311-4aef-b6c1-5f84f0f3c94d, 9dbe6b1e-2a98-449e-8bd7-2d025c420a42, 54b872c6-cefc-4a19-b48e-9bc1a09285f9]), log id: 642f2d61 >2012-08-07 11:49:40,746 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [679f8129] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, vm=org.ovirt.engine.core.common.businessentities.VM@7a37502f), log id: 68c95627 >2012-08-07 11:49:40,752 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-76) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@45717c58, log id: 642f2d61 >2012-08-07 11:49:40,757 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 devices, skipping device: {specParams={}, device=ich6, type=sound, deviceId=e55c5b92-a54b-4e0f-8563-bbc3c0d982a9}. >2012-08-07 11:49:40,758 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 devices, skipping device: {specParams={vram=65536}, device=qxl, type=video, deviceId=df57dc7c-19f5-4341-b127-989121b96f86}. >2012-08-07 11:49:40,759 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 devices, skipping device: {nicModel=pv, specParams={}, device=bridge, macAddr=00:1a:4a:23:61:5e, type=interface, deviceId=74817040-ecb2-49c0-a948-10c554154d76, network=rhevm}. >2012-08-07 11:49:40,760 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 devices, skipping device: {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=b01f2bd9-52b1-40b4-903f-df536fe64518}. >2012-08-07 11:49:40,761 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 devices, skipping device: {shared=false, iface=ide, index=2, specParams={path=}, device=cdrom, path=, type=disk, readonly=true, deviceId=ef137c30-7d86-468d-a066-978cbf94189f}. >2012-08-07 11:49:40,762 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 devices, skipping device: {shared=false, volumeID=2d939f22-00ff-43b9-bf4c-e51f03a245bb, index=0, propagateErrors=off, format=cow, type=disk, truesize=139264, reqsize=0, bootOrder=1, iface=virtio, volumeChain=[Ljava.lang.Object;@30842bdb, imageID=72fb765c-6215-4011-84ba-f85696ff14df, domainID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, specParams={}, optional=false, needExtend=false, path=/rhev/data-center/efe20197-e0a7-49b8-beb4-19b1ed3f8c3f/a9af3dac-1730-4ec8-8d7f-0507cee4aa1a/images/72fb765c-6215-4011-84ba-f85696ff14df/2d939f22-00ff-43b9-bf4c-e51f03a245bb, device=disk, poolID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, readonly=false, apparentsize=262144, deviceId=72fb765c-6215-4011-84ba-f85696ff14df}. >2012-08-07 11:49:40,764 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 managed non plugable device was removed unexpetedly from libvirt: VmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19,DeviceId=df57dc7c-19f5-4341-b127-989121b96f86,Device=qxl,Type=video,BootOrder=0,SpecParams={vram=65536},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=false,alias= >2012-08-07 11:49:40,767 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 managed non plugable device was removed unexpetedly from libvirt: VmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19,DeviceId=b01f2bd9-52b1-40b4-903f-df536fe64518,Device=memballoon,Type=balloon,BootOrder=0,SpecParams={model=virtio},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=true,alias= >2012-08-07 11:49:40,769 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 managed non plugable device was removed unexpetedly from libvirt: VmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19,DeviceId=74817040-ecb2-49c0-a948-10c554154d76,Device=bridge,Type=interface,BootOrder=0,SpecParams={},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=false,alias= >2012-08-07 11:49:40,770 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 managed non plugable device was removed unexpetedly from libvirt: VmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19,DeviceId=72fb765c-6215-4011-84ba-f85696ff14df,Device=disk,Type=disk,BootOrder=1,SpecParams={},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=false,alias= >2012-08-07 11:49:40,771 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 managed non plugable device was removed unexpetedly from libvirt: VmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19,DeviceId=ef137c30-7d86-468d-a066-978cbf94189f,Device=cdrom,Type=disk,BootOrder=0,SpecParams={path=},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=true,alias= >2012-08-07 11:49:40,772 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 managed non plugable device was removed unexpetedly from libvirt: VmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19,DeviceId=e55c5b92-a54b-4e0f-8563-bbc3c0d982a9,Device=ich6,Type=sound,BootOrder=0,SpecParams={},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=true,alias= >2012-08-07 11:49:40,784 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM 54b872c6-cefc-4a19-b48e-9bc1a09285f9 devices, skipping device: {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=746d95f4-8372-49a8-b6f9-c9c79c8d62d6}. >2012-08-07 11:49:40,788 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM 54b872c6-cefc-4a19-b48e-9bc1a09285f9 managed non plugable device was removed unexpetedly from libvirt: VmId=54b872c6-cefc-4a19-b48e-9bc1a09285f9,DeviceId=746d95f4-8372-49a8-b6f9-c9c79c8d62d6,Device=memballoon,Type=balloon,BootOrder=0,SpecParams={model=virtio},Address={bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0},IsManaged=true,IsPlugged=true,IsReadOnly=true,alias=balloon0 >2012-08-07 11:49:40,793 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 devices, skipping device: {specParams={vram=65536}, device=qxl, type=video, deviceId=571b4c2a-ea51-447d-882c-f6091f47accf}. >2012-08-07 11:49:40,793 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 devices, skipping device: {shared=false, iface=ide, index=2, specParams={path=}, device=cdrom, path=, type=disk, readonly=true, deviceId=1e34b955-4985-46e2-a768-d70eeb93eeba}. >2012-08-07 11:49:40,795 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 devices, skipping device: {shared=false, index=0, volumeID=50efadf7-60c6-483a-93d8-b679dc268947, propagateErrors=off, format=cow, type=disk, iface=virtio, bootOrder=1, imageID=b71e5cca-0cb0-4a6c-9be6-b66a2991cd93, domainID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, specParams={}, optional=false, device=disk, poolID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, readonly=false, deviceId=b71e5cca-0cb0-4a6c-9be6-b66a2991cd93}. >2012-08-07 11:49:40,796 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 devices, skipping device: {nicModel=pv, specParams={}, device=bridge, macAddr=00:1a:4a:23:61:5b, type=interface, deviceId=4b7c897c-2c25-4b97-b80f-d1872f118679, network=rhevm}. >2012-08-07 11:49:40,797 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 devices, skipping device: {specParams={}, device=ich6, type=sound, deviceId=ba3746ce-fec9-49d7-8f3c-cba8f31300dc}. >2012-08-07 11:49:40,798 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 devices, skipping device: {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=a67d1ef1-b25b-4aee-8a4d-062dc987a290}. >2012-08-07 11:49:40,799 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 managed non plugable device was removed unexpetedly from libvirt: VmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42,DeviceId=571b4c2a-ea51-447d-882c-f6091f47accf,Device=qxl,Type=video,BootOrder=0,SpecParams={vram=65536},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=false,alias= >2012-08-07 11:49:40,801 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 managed non plugable device was removed unexpetedly from libvirt: VmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42,DeviceId=a67d1ef1-b25b-4aee-8a4d-062dc987a290,Device=memballoon,Type=balloon,BootOrder=0,SpecParams={model=virtio},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=true,alias= >2012-08-07 11:49:40,802 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 managed non plugable device was removed unexpetedly from libvirt: VmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42,DeviceId=4b7c897c-2c25-4b97-b80f-d1872f118679,Device=bridge,Type=interface,BootOrder=0,SpecParams={},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=false,alias= >2012-08-07 11:49:40,804 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 managed non plugable device was removed unexpetedly from libvirt: VmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42,DeviceId=b71e5cca-0cb0-4a6c-9be6-b66a2991cd93,Device=disk,Type=disk,BootOrder=1,SpecParams={},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=false,alias= >2012-08-07 11:49:40,805 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 managed non plugable device was removed unexpetedly from libvirt: VmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42,DeviceId=1e34b955-4985-46e2-a768-d70eeb93eeba,Device=cdrom,Type=disk,BootOrder=0,SpecParams={path=},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=true,alias= >2012-08-07 11:49:40,806 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 managed non plugable device was removed unexpetedly from libvirt: VmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42,DeviceId=ba3746ce-fec9-49d7-8f3c-cba8f31300dc,Device=ich6,Type=sound,BootOrder=0,SpecParams={},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=true,alias= >2012-08-07 11:49:40,811 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM 8738bb81-c73e-4a41-a24a-c4c49491c536 devices, skipping device: {specParams={}, device=ich6, type=sound, deviceId=023ea382-f450-481d-aedb-aeb6a145824f}. >2012-08-07 11:49:40,812 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM 8738bb81-c73e-4a41-a24a-c4c49491c536 devices, skipping device: {specParams={vram=65536}, device=qxl, type=video, deviceId=2c6bc991-391b-4262-9f4d-0bd2ca1892cd}. >2012-08-07 11:49:40,813 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM 8738bb81-c73e-4a41-a24a-c4c49491c536 devices, skipping device: {nicModel=pv, specParams={}, device=bridge, macAddr=00:1a:4a:23:61:5d, type=interface, deviceId=d9aeb8ce-f03d-4609-a341-9b0e242564be, network=rhevm}. >2012-08-07 11:49:40,814 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM 8738bb81-c73e-4a41-a24a-c4c49491c536 devices, skipping device: {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=89b2070a-7eed-48fa-96f7-60c0439938b7}. >2012-08-07 11:49:40,815 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM 8738bb81-c73e-4a41-a24a-c4c49491c536 devices, skipping device: {shared=false, iface=ide, index=2, specParams={path=}, device=cdrom, path=, type=disk, readonly=true, deviceId=635b0e01-a55c-4301-b888-446a63648a5d}. >2012-08-07 11:49:40,816 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM 8738bb81-c73e-4a41-a24a-c4c49491c536 devices, skipping device: {shared=false, volumeID=a577575b-4550-4dcb-a2c2-71f511c02c89, index=0, propagateErrors=off, format=cow, type=disk, truesize=139264, reqsize=0, bootOrder=1, iface=virtio, volumeChain=[Ljava.lang.Object;@4a980805, imageID=23c850b9-0278-4cb8-8ef3-ee8939c1bc06, domainID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, specParams={}, optional=false, needExtend=false, path=/rhev/data-center/efe20197-e0a7-49b8-beb4-19b1ed3f8c3f/a9af3dac-1730-4ec8-8d7f-0507cee4aa1a/images/23c850b9-0278-4cb8-8ef3-ee8939c1bc06/a577575b-4550-4dcb-a2c2-71f511c02c89, device=disk, poolID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, readonly=false, apparentsize=262144, deviceId=23c850b9-0278-4cb8-8ef3-ee8939c1bc06}. >2012-08-07 11:49:40,818 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM 8738bb81-c73e-4a41-a24a-c4c49491c536 managed non plugable device was removed unexpetedly from libvirt: VmId=8738bb81-c73e-4a41-a24a-c4c49491c536,DeviceId=2c6bc991-391b-4262-9f4d-0bd2ca1892cd,Device=qxl,Type=video,BootOrder=0,SpecParams={vram=65536},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=false,alias= >2012-08-07 11:49:40,820 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM 8738bb81-c73e-4a41-a24a-c4c49491c536 managed non plugable device was removed unexpetedly from libvirt: VmId=8738bb81-c73e-4a41-a24a-c4c49491c536,DeviceId=89b2070a-7eed-48fa-96f7-60c0439938b7,Device=memballoon,Type=balloon,BootOrder=0,SpecParams={model=virtio},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=true,alias= >2012-08-07 11:49:40,821 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM 8738bb81-c73e-4a41-a24a-c4c49491c536 managed non plugable device was removed unexpetedly from libvirt: VmId=8738bb81-c73e-4a41-a24a-c4c49491c536,DeviceId=d9aeb8ce-f03d-4609-a341-9b0e242564be,Device=bridge,Type=interface,BootOrder=0,SpecParams={},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=false,alias= >2012-08-07 11:49:40,822 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM 8738bb81-c73e-4a41-a24a-c4c49491c536 managed non plugable device was removed unexpetedly from libvirt: VmId=8738bb81-c73e-4a41-a24a-c4c49491c536,DeviceId=23c850b9-0278-4cb8-8ef3-ee8939c1bc06,Device=disk,Type=disk,BootOrder=1,SpecParams={},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=false,alias= >2012-08-07 11:49:40,823 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM 8738bb81-c73e-4a41-a24a-c4c49491c536 managed non plugable device was removed unexpetedly from libvirt: VmId=8738bb81-c73e-4a41-a24a-c4c49491c536,DeviceId=635b0e01-a55c-4301-b888-446a63648a5d,Device=cdrom,Type=disk,BootOrder=0,SpecParams={path=},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=true,alias= >2012-08-07 11:49:40,825 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM 8738bb81-c73e-4a41-a24a-c4c49491c536 managed non plugable device was removed unexpetedly from libvirt: VmId=8738bb81-c73e-4a41-a24a-c4c49491c536,DeviceId=023ea382-f450-481d-aedb-aeb6a145824f,Device=ich6,Type=sound,BootOrder=0,SpecParams={},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=true,alias= >2012-08-07 11:49:40,829 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM ba81adbe-b311-4aef-b6c1-5f84f0f3c94d devices, skipping device: {specParams={vram=65536}, device=qxl, type=video, deviceId=f6b43d77-3889-4303-9c59-5a175dabef01}. >2012-08-07 11:49:40,830 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM ba81adbe-b311-4aef-b6c1-5f84f0f3c94d devices, skipping device: {nicModel=pv, specParams={}, device=bridge, macAddr=00:1a:4a:23:61:69, type=interface, deviceId=4e67a9e2-54d8-429a-bfd2-d0f92fa14e5d, network=rhevm}. >2012-08-07 11:49:40,831 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM ba81adbe-b311-4aef-b6c1-5f84f0f3c94d devices, skipping device: {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=42e86cd4-259d-4c05-8dbe-ec107fefde75}. >2012-08-07 11:49:40,832 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM ba81adbe-b311-4aef-b6c1-5f84f0f3c94d devices, skipping device: {shared=false, iface=ide, index=2, specParams={path=}, device=cdrom, path=, type=disk, readonly=true, deviceId=a35d6711-102a-479a-8bc3-65f47a281115}. >2012-08-07 11:49:40,833 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) Recieved a Device without an address when processing VM ba81adbe-b311-4aef-b6c1-5f84f0f3c94d devices, skipping device: {shared=false, index=0, volumeID=33107dbd-e746-4c65-ba13-7c1c2c5af3a1, propagateErrors=off, format=raw, type=disk, truesize=0, reqsize=0, iface=virtio, volumeChain=[Ljava.lang.Object;@13a262f1, imageID=9c931956-f081-4418-afc2-ce5f5cfa132f, domainID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, specParams={}, optional=false, needExtend=false, path=/rhev/data-center/efe20197-e0a7-49b8-beb4-19b1ed3f8c3f/a9af3dac-1730-4ec8-8d7f-0507cee4aa1a/images/9c931956-f081-4418-afc2-ce5f5cfa132f/33107dbd-e746-4c65-ba13-7c1c2c5af3a1, device=disk, poolID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, readonly=false, apparentsize=1073741824, deviceId=9c931956-f081-4418-afc2-ce5f5cfa132f}. >2012-08-07 11:49:40,835 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM ba81adbe-b311-4aef-b6c1-5f84f0f3c94d managed non plugable device was removed unexpetedly from libvirt: VmId=ba81adbe-b311-4aef-b6c1-5f84f0f3c94d,DeviceId=f6b43d77-3889-4303-9c59-5a175dabef01,Device=qxl,Type=video,BootOrder=0,SpecParams={vram=65536},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=false,alias= >2012-08-07 11:49:40,837 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM ba81adbe-b311-4aef-b6c1-5f84f0f3c94d managed non plugable device was removed unexpetedly from libvirt: VmId=ba81adbe-b311-4aef-b6c1-5f84f0f3c94d,DeviceId=42e86cd4-259d-4c05-8dbe-ec107fefde75,Device=memballoon,Type=balloon,BootOrder=0,SpecParams={model=virtio},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=true,alias= >2012-08-07 11:49:40,838 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM ba81adbe-b311-4aef-b6c1-5f84f0f3c94d managed non plugable device was removed unexpetedly from libvirt: VmId=ba81adbe-b311-4aef-b6c1-5f84f0f3c94d,DeviceId=a35d6711-102a-479a-8bc3-65f47a281115,Device=cdrom,Type=disk,BootOrder=0,SpecParams={path=},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=true,alias= >2012-08-07 11:49:40,839 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM ba81adbe-b311-4aef-b6c1-5f84f0f3c94d managed non plugable device was removed unexpetedly from libvirt: VmId=ba81adbe-b311-4aef-b6c1-5f84f0f3c94d,DeviceId=4e67a9e2-54d8-429a-bfd2-d0f92fa14e5d,Device=bridge,Type=interface,BootOrder=0,SpecParams={},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=false,alias= >2012-08-07 11:49:40,840 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) VM ba81adbe-b311-4aef-b6c1-5f84f0f3c94d managed non plugable device was removed unexpetedly from libvirt: VmId=ba81adbe-b311-4aef-b6c1-5f84f0f3c94d,DeviceId=9c931956-f081-4418-afc2-ce5f5cfa132f,Device=disk,Type=disk,BootOrder=0,SpecParams={},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=false,alias= >2012-08-07 11:49:40,962 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [679f8129] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, vm=org.ovirt.engine.core.common.businessentities.VM@7a37502f), log id: 77b57dac >2012-08-07 11:49:41,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [679f8129] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=e5a192f1-3f9d-48e1-a817-28f72815c646,devices=[Ljava.util.Map;@525eb9cd,acpiEnable=true,vmName=pool1-12,cpuType=Conroe,custom={} >2012-08-07 11:49:41,027 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [679f8129] FINISH, CreateVDSCommand, log id: 77b57dac >2012-08-07 11:49:41,033 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [679f8129] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 6. Vm: pool1-12 >2012-08-07 11:49:41,076 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [679f8129] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 68c95627 >2012-08-07 11:49:41,077 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [679f8129] Lock freed to object EngineLock [exclusiveLocks= key: e5a192f1-3f9d-48e1-a817-28f72815c646 value: VM >, sharedLocks= ] >2012-08-07 11:49:41,196 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [571d8f42] Running command: RunVmCommand internal: false. Entities affected : ID: 6c1fcddf-86d6-4533-905b-abb11b775f5b Type: VM >2012-08-07 11:49:41,237 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [571d8f42] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, vm=org.ovirt.engine.core.common.businessentities.VM@1fe7f77f), log id: 5af74551 >2012-08-07 11:49:41,241 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [571d8f42] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, vm=org.ovirt.engine.core.common.businessentities.VM@1fe7f77f), log id: 6cd1f792 >2012-08-07 11:49:41,288 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [571d8f42] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b,devices=[Ljava.util.Map;@79024095,acpiEnable=true,vmName=pool1-13,cpuType=Conroe,custom={} >2012-08-07 11:49:41,289 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [571d8f42] FINISH, CreateVDSCommand, log id: 6cd1f792 >2012-08-07 11:49:41,295 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [571d8f42] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 7. Vm: pool1-13 >2012-08-07 11:49:41,354 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [571d8f42] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 5af74551 >2012-08-07 11:49:41,355 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [571d8f42] Lock freed to object EngineLock [exclusiveLocks= key: 6c1fcddf-86d6-4533-905b-abb11b775f5b value: VM >, sharedLocks= ] >2012-08-07 11:49:41,439 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [6fd63ad6] Running command: RunVmCommand internal: false. Entities affected : ID: 2842672f-6230-434f-8232-e88e71560092 Type: VM >2012-08-07 11:49:41,464 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [6fd63ad6] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, vm=org.ovirt.engine.core.common.businessentities.VM@21339320), log id: 5a91b1f >2012-08-07 11:49:41,468 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [6fd63ad6] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, vm=org.ovirt.engine.core.common.businessentities.VM@21339320), log id: a583e9a >2012-08-07 11:49:41,520 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [6fd63ad6] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=2842672f-6230-434f-8232-e88e71560092,devices=[Ljava.util.Map;@6ae761c,acpiEnable=true,vmName=pool1-14,cpuType=Conroe,custom={} >2012-08-07 11:49:41,523 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [6fd63ad6] FINISH, CreateVDSCommand, log id: a583e9a >2012-08-07 11:49:41,530 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [6fd63ad6] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 8. Vm: pool1-14 >2012-08-07 11:49:41,562 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [6fd63ad6] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 5a91b1f >2012-08-07 11:49:41,567 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [6fd63ad6] Lock freed to object EngineLock [exclusiveLocks= key: 2842672f-6230-434f-8232-e88e71560092 value: VM >, sharedLocks= ] >2012-08-07 11:49:41,681 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [ffb834f] Running command: RunVmCommand internal: false. Entities affected : ID: 5524b98a-aa45-49cb-9d8b-bec3884753c9 Type: VM >2012-08-07 11:49:41,702 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [ffb834f] Cant find VDS to run the VM 5524b98a-aa45-49cb-9d8b-bec3884753c9 on, so this VM will not be run. >2012-08-07 11:49:41,730 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [ffb834f] Lock freed to object EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] >2012-08-07 11:49:41,837 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [3c8817d0] Running command: RunVmCommand internal: false. Entities affected : ID: c1cb365c-a119-493c-964c-faf65a10c889 Type: VM >2012-08-07 11:49:41,845 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [3c8817d0] Cant find VDS to run the VM c1cb365c-a119-493c-964c-faf65a10c889 on, so this VM will not be run. >2012-08-07 11:49:41,863 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [3c8817d0] Lock freed to object EngineLock [exclusiveLocks= key: c1cb365c-a119-493c-964c-faf65a10c889 value: VM >, sharedLocks= ] >2012-08-07 11:49:41,999 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [7f22801a] Running command: RunVmCommand internal: false. Entities affected : ID: c7702cf0-88da-4885-9b9c-9e59772b3774 Type: VM >2012-08-07 11:49:42,007 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [7f22801a] Cant find VDS to run the VM c7702cf0-88da-4885-9b9c-9e59772b3774 on, so this VM will not be run. >2012-08-07 11:49:42,039 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [7f22801a] Lock freed to object EngineLock [exclusiveLocks= key: c7702cf0-88da-4885-9b9c-9e59772b3774 value: VM >, sharedLocks= ] >2012-08-07 11:49:42,154 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [64ddeb64] Running command: RunVmCommand internal: false. Entities affected : ID: 3ce0f220-6cb8-42d8-b922-7003c60ccdad Type: VM >2012-08-07 11:49:42,162 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [64ddeb64] Cant find VDS to run the VM 3ce0f220-6cb8-42d8-b922-7003c60ccdad on, so this VM will not be run. >2012-08-07 11:49:42,182 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [64ddeb64] Lock freed to object EngineLock [exclusiveLocks= key: 3ce0f220-6cb8-42d8-b922-7003c60ccdad value: VM >, sharedLocks= ] >2012-08-07 11:49:42,312 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [234009a0] Running command: RunVmCommand internal: false. Entities affected : ID: 6df57989-99a7-4ec9-8f7c-15f222064e61 Type: VM >2012-08-07 11:49:42,320 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [234009a0] Cant find VDS to run the VM 6df57989-99a7-4ec9-8f7c-15f222064e61 on, so this VM will not be run. >2012-08-07 11:49:42,342 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [234009a0] Lock freed to object EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-07 11:49:42,441 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [45dc194e] Running command: RunVmCommand internal: false. Entities affected : ID: d3c805a2-419c-480f-8627-f5c9ef5c4117 Type: VM >2012-08-07 11:49:42,461 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [45dc194e] Cant find VDS to run the VM d3c805a2-419c-480f-8627-f5c9ef5c4117 on, so this VM will not be run. >2012-08-07 11:49:42,483 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [45dc194e] Lock freed to object EngineLock [exclusiveLocks= key: d3c805a2-419c-480f-8627-f5c9ef5c4117 value: VM >, sharedLocks= ] >2012-08-07 11:49:42,596 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [4a13fa18] Running command: RunVmCommand internal: false. Entities affected : ID: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 Type: VM >2012-08-07 11:49:42,606 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [4a13fa18] Cant find VDS to run the VM a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 on, so this VM will not be run. >2012-08-07 11:49:42,633 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [4a13fa18] Lock freed to object EngineLock [exclusiveLocks= key: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 value: VM >, sharedLocks= ] >2012-08-07 11:49:42,766 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [586f26d9] Running command: RunVmCommand internal: false. Entities affected : ID: 3c7c0453-5f05-4314-bdd4-eb4fd243f80a Type: VM >2012-08-07 11:49:42,773 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [586f26d9] Cant find VDS to run the VM 3c7c0453-5f05-4314-bdd4-eb4fd243f80a on, so this VM will not be run. >2012-08-07 11:49:42,812 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [586f26d9] Lock freed to object EngineLock [exclusiveLocks= key: 3c7c0453-5f05-4314-bdd4-eb4fd243f80a value: VM >, sharedLocks= ] >2012-08-07 11:49:42,973 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [74c4eda4] Running command: RunVmCommand internal: false. Entities affected : ID: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 Type: VM >2012-08-07 11:49:42,990 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [74c4eda4] Cant find VDS to run the VM 96405d4a-a3bd-4900-ab90-9c8736cb02a5 on, so this VM will not be run. >2012-08-07 11:49:43,014 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [74c4eda4] Lock freed to object EngineLock [exclusiveLocks= key: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 value: VM >, sharedLocks= ] >2012-08-07 11:49:43,113 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-36) VM pool1-9 8738bb81-c73e-4a41-a24a-c4c49491c536 moved from WaitForLaunch --> PoweringUp >2012-08-07 11:49:43,114 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-36) VM pool1-10 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 moved from WaitForLaunch --> PoweringUp >2012-08-07 11:49:43,114 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-36) VM new ba81adbe-b311-4aef-b6c1-5f84f0f3c94d moved from WaitForLaunch --> PoweringUp >2012-08-07 11:49:43,115 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-36) VM lesik 54b872c6-cefc-4a19-b48e-9bc1a09285f9 moved from WaitForLaunch --> PoweringUp >2012-08-07 11:49:43,115 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-36) START, FullListVdsCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=null, vmIds=[8738bb81-c73e-4a41-a24a-c4c49491c536, 6a729fb0-47fe-4eba-9ba3-2b939eee2b19, ba81adbe-b311-4aef-b6c1-5f84f0f3c94d, 54b872c6-cefc-4a19-b48e-9bc1a09285f9]), log id: 2204c689 >2012-08-07 11:49:43,142 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-36) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@67865dd1, log id: 2204c689 >2012-08-07 11:49:47,889 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-55) [3851d7c] VM pool1-13 6c1fcddf-86d6-4533-905b-abb11b775f5b moved from WaitForLaunch --> PoweringUp >2012-08-07 11:49:47,890 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-55) [3851d7c] VM pool1-14 2842672f-6230-434f-8232-e88e71560092 moved from WaitForLaunch --> PoweringUp >2012-08-07 11:49:47,891 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-55) [3851d7c] VM pool1-12 e5a192f1-3f9d-48e1-a817-28f72815c646 moved from WaitForLaunch --> PoweringUp >2012-08-07 11:49:47,892 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-55) [3851d7c] VM pool1-11 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 moved from WaitForLaunch --> PoweringUp >2012-08-07 11:49:47,892 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-55) [3851d7c] START, FullListVdsCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=null, vmIds=[6c1fcddf-86d6-4533-905b-abb11b775f5b, 2842672f-6230-434f-8232-e88e71560092, e5a192f1-3f9d-48e1-a817-28f72815c646, 9dbe6b1e-2a98-449e-8bd7-2d025c420a42]), log id: 2dcbfca7 >2012-08-07 11:49:47,923 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-55) [3851d7c] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@2b384f6e, log id: 2dcbfca7 >2012-08-07 11:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) [39ead820] Checking autorecoverable hosts >2012-08-07 11:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) [39ead820] Autorecovering 0 hosts >2012-08-07 11:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) [39ead820] Checking autorecoverable hosts done >2012-08-07 11:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) [39ead820] Checking autorecoverable storage domains >2012-08-07 11:50:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) [39ead820] Autorecovering 1 storage domains >2012-08-07 11:50:00,020 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) [39ead820] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 11:50:00,022 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [4e51d123] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:50:00,053 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [4e51d123] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 11:50:00,070 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [4e51d123] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:50:00,071 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [4e51d123] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 11:50 AM >2012-08-07 11:50:00,087 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-41) [4e51d123] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 58c9649a >2012-08-07 11:50:40,209 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-7) [5036be57] VM pool1-9 8738bb81-c73e-4a41-a24a-c4c49491c536 moved from PoweringUp --> Up >2012-08-07 11:50:40,210 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-7) [5036be57] VM new ba81adbe-b311-4aef-b6c1-5f84f0f3c94d moved from PoweringUp --> Up >2012-08-07 11:50:40,211 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-7) [5036be57] VM lesik 54b872c6-cefc-4a19-b48e-9bc1a09285f9 moved from PoweringUp --> Up >2012-08-07 11:50:40,231 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-7) [5036be57] START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@af3e55af), log id: 2e7fb09a >2012-08-07 11:50:40,246 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-7) [5036be57] FINISH, UpdateVdsDynamicDataVDSCommand, log id: 2e7fb09a >2012-08-07 11:50:40,274 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-7) [5036be57] START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@16d7f5d0), log id: 68904f49 >2012-08-07 11:50:40,292 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-7) [5036be57] FINISH, UpdateVdsDynamicDataVDSCommand, log id: 68904f49 >2012-08-07 11:50:40,320 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-7) [5036be57] START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@c79d13f1), log id: 7075f7e8 >2012-08-07 11:50:40,334 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-7) [5036be57] FINISH, UpdateVdsDynamicDataVDSCommand, log id: 7075f7e8 >2012-08-07 11:50:42,594 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-36) VM pool1-13 6c1fcddf-86d6-4533-905b-abb11b775f5b moved from PoweringUp --> Up >2012-08-07 11:50:42,595 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-36) VM pool1-14 2842672f-6230-434f-8232-e88e71560092 moved from PoweringUp --> Up >2012-08-07 11:50:42,596 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-36) VM pool1-12 e5a192f1-3f9d-48e1-a817-28f72815c646 moved from PoweringUp --> Up >2012-08-07 11:50:42,596 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-36) VM pool1-10 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 moved from PoweringUp --> Up >2012-08-07 11:50:42,597 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-36) VM pool1-11 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 moved from PoweringUp --> Up >2012-08-07 11:50:42,636 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-36) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@2f36b412), log id: 1e73d3a1 >2012-08-07 11:50:42,655 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-36) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 1e73d3a1 >2012-08-07 11:50:42,686 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-36) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@96d05433), log id: 3a1614a6 >2012-08-07 11:50:42,701 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-36) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 3a1614a6 >2012-08-07 11:50:42,738 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-36) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@fe69f454), log id: 250ee2a6 >2012-08-07 11:50:42,750 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-36) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 250ee2a6 >2012-08-07 11:50:42,821 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-36) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@66039475), log id: 7c7f2146 >2012-08-07 11:50:42,855 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-36) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 7c7f2146 >2012-08-07 11:50:42,897 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-36) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@cd9d3496), log id: 70e41deb >2012-08-07 11:50:42,910 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-36) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 70e41deb >2012-08-07 11:52:24,602 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/7/12 11:52 AM. Start running CanDoAction for command number 2/5 (Command type: ShutdownVm) >2012-08-07 11:52:24,605 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/7/12 11:52 AM. Start running CanDoAction for command number 3/5 (Command type: ShutdownVm) >2012-08-07 11:52:24,607 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/7/12 11:52 AM. Start running CanDoAction for command number 4/5 (Command type: ShutdownVm) >2012-08-07 11:52:24,609 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/7/12 11:52 AM. Start running CanDoAction for command number 5/5 (Command type: ShutdownVm) >2012-08-07 11:52:24,624 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) Start time: 8/7/12 11:52 AM. Start running CanDoAction for command number 1/5 (Command type: ShutdownVm) >2012-08-07 11:52:24,644 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/7/12 11:52 AM. Finish handling CanDoAction for command number 4/5 (Command type: ShutdownVm) >2012-08-07 11:52:24,653 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/7/12 11:52 AM. Finish handling CanDoAction for command number 3/5 (Command type: ShutdownVm) >2012-08-07 11:52:24,664 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/7/12 11:52 AM. Finish handling CanDoAction for command number 5/5 (Command type: ShutdownVm) >2012-08-07 11:52:24,689 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/7/12 11:52 AM. Finish handling CanDoAction for command number 2/5 (Command type: ShutdownVm) >2012-08-07 11:52:24,696 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) End time: 8/7/12 11:52 AM. Finish handling CanDoAction for command number 1/5 (Command type: ShutdownVm) >2012-08-07 11:52:24,811 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-49) [694e2d17] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 Type: VM >2012-08-07 11:52:24,813 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-49) [694e2d17] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-10). >2012-08-07 11:52:24,813 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-49) [694e2d17] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-10. >2012-08-07 11:52:24,814 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-49) [694e2d17] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, force=false, secondsToWait=30, gracefully=true), log id: 72d8cf1f >2012-08-07 11:52:24,818 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-49) [694e2d17] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, force=false, secondsToWait=30, gracefully=true), log id: 72a78287 >2012-08-07 11:52:24,893 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-49) [694e2d17] FINISH, DestroyVDSCommand, log id: 72a78287 >2012-08-07 11:52:24,914 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-49) [694e2d17] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 72d8cf1f >2012-08-07 11:52:25,121 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-49) [b727704] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 Type: VM >2012-08-07 11:52:25,123 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-49) [b727704] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-11). >2012-08-07 11:52:25,124 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-49) [b727704] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-11. >2012-08-07 11:52:25,125 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-49) [b727704] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42, force=false, secondsToWait=30, gracefully=true), log id: 557112e7 >2012-08-07 11:52:25,130 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-49) [b727704] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42, force=false, secondsToWait=30, gracefully=true), log id: 4426e6cd >2012-08-07 11:52:25,188 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-49) [b727704] FINISH, DestroyVDSCommand, log id: 4426e6cd >2012-08-07 11:52:25,216 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-49) [b727704] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 557112e7 >2012-08-07 11:52:25,321 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-49) [7e3ad7b] Running command: ShutdownVmCommand internal: false. Entities affected : ID: e5a192f1-3f9d-48e1-a817-28f72815c646 Type: VM >2012-08-07 11:52:25,323 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-49) [7e3ad7b] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-12). >2012-08-07 11:52:25,323 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-49) [7e3ad7b] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-12. >2012-08-07 11:52:25,324 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-49) [7e3ad7b] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, force=false, secondsToWait=30, gracefully=true), log id: 664de8f4 >2012-08-07 11:52:25,329 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-49) [7e3ad7b] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, force=false, secondsToWait=30, gracefully=true), log id: 502673a >2012-08-07 11:52:25,387 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-49) [7e3ad7b] FINISH, DestroyVDSCommand, log id: 502673a >2012-08-07 11:52:25,411 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-49) [7e3ad7b] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 664de8f4 >2012-08-07 11:52:25,537 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-49) [74926a48] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 6c1fcddf-86d6-4533-905b-abb11b775f5b Type: VM >2012-08-07 11:52:25,539 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-49) [74926a48] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-13). >2012-08-07 11:52:25,540 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-49) [74926a48] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-13. >2012-08-07 11:52:25,540 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-49) [74926a48] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, force=false, secondsToWait=30, gracefully=true), log id: 53769d92 >2012-08-07 11:52:25,545 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-49) [74926a48] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, force=false, secondsToWait=30, gracefully=true), log id: 2562b4f9 >2012-08-07 11:52:25,603 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-49) [74926a48] FINISH, DestroyVDSCommand, log id: 2562b4f9 >2012-08-07 11:52:25,630 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-49) [74926a48] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 53769d92 >2012-08-07 11:52:25,787 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-49) [387fd8c2] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 2842672f-6230-434f-8232-e88e71560092 Type: VM >2012-08-07 11:52:25,789 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-49) [387fd8c2] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-14). >2012-08-07 11:52:25,789 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-49) [387fd8c2] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-14. >2012-08-07 11:52:25,790 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-49) [387fd8c2] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, force=false, secondsToWait=30, gracefully=true), log id: 76fc6ec9 >2012-08-07 11:52:25,794 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-49) [387fd8c2] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, force=false, secondsToWait=30, gracefully=true), log id: 12a39ce2 >2012-08-07 11:52:25,849 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-49) [387fd8c2] FINISH, DestroyVDSCommand, log id: 12a39ce2 >2012-08-07 11:52:25,877 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-49) [387fd8c2] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 76fc6ec9 >2012-08-07 11:53:00,090 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-41) [4e51d123] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 11:53:00,091 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-41) [4e51d123] FINISH, ConnectStorageServerVDSCommand, log id: 58c9649a >2012-08-07 11:53:00,092 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-41) [4e51d123] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 11:53:00,098 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [4e51d123] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 11:53 AM >2012-08-07 11:53:00,099 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-30) [4e51d123] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 1617dbb1 >2012-08-07 11:53:00,359 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-30) [4e51d123] Failed in ActivateStorageDomainVDS method >2012-08-07 11:53:00,360 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-30) [4e51d123] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:53:00,361 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-30) [4e51d123] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:53:00,366 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-30) [4e51d123] FINISH, ActivateStorageDomainVDSCommand, log id: 1617dbb1 >2012-08-07 11:53:00,367 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [4e51d123] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 11:53:00,371 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-30) [4e51d123] Command [id=ba6dbfcf-0100-4411-b4fb-52d7536565b8]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 11:53:00,395 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-30) [4e51d123] Checking autorecoverable storage domains done >2012-08-07 11:53:59,511 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/7/12 11:53 AM. Start running CanDoAction for command number 1/2 (Command type: ShutdownVm) >2012-08-07 11:53:59,512 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-41) Start time: 8/7/12 11:53 AM. Start running CanDoAction for command number 2/2 (Command type: ShutdownVm) >2012-08-07 11:53:59,523 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-41) End time: 8/7/12 11:53 AM. Finish handling CanDoAction for command number 2/2 (Command type: ShutdownVm) >2012-08-07 11:53:59,528 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/7/12 11:53 AM. Finish handling CanDoAction for command number 1/2 (Command type: ShutdownVm) >2012-08-07 11:53:59,605 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) [409b16b2] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 Type: VM >2012-08-07 11:53:59,608 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) [409b16b2] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop lesik). >2012-08-07 11:53:59,608 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) [409b16b2] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop lesik. >2012-08-07 11:53:59,609 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-47) [409b16b2] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=54b872c6-cefc-4a19-b48e-9bc1a09285f9, force=false, secondsToWait=30, gracefully=true), log id: 86274ce >2012-08-07 11:53:59,616 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-47) [409b16b2] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=54b872c6-cefc-4a19-b48e-9bc1a09285f9, force=false, secondsToWait=30, gracefully=true), log id: 57cee940 >2012-08-07 11:53:59,676 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-47) [409b16b2] FINISH, DestroyVDSCommand, log id: 57cee940 >2012-08-07 11:53:59,696 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-47) [409b16b2] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 86274ce >2012-08-07 11:53:59,888 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) [5ef2141] Running command: ShutdownVmCommand internal: false. Entities affected : ID: ba81adbe-b311-4aef-b6c1-5f84f0f3c94d Type: VM >2012-08-07 11:53:59,890 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) [5ef2141] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop new). >2012-08-07 11:53:59,890 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) [5ef2141] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop new. >2012-08-07 11:53:59,891 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-47) [5ef2141] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=ba81adbe-b311-4aef-b6c1-5f84f0f3c94d, force=false, secondsToWait=30, gracefully=true), log id: 436c80a4 >2012-08-07 11:53:59,896 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-47) [5ef2141] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=ba81adbe-b311-4aef-b6c1-5f84f0f3c94d, force=false, secondsToWait=30, gracefully=true), log id: 5dba8635 >2012-08-07 11:53:59,952 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-47) [5ef2141] FINISH, DestroyVDSCommand, log id: 5dba8635 >2012-08-07 11:53:59,972 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-47) [5ef2141] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 436c80a4 >2012-08-07 11:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [156ae689] Checking autorecoverable hosts >2012-08-07 11:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [156ae689] Autorecovering 0 hosts >2012-08-07 11:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [156ae689] Checking autorecoverable hosts done >2012-08-07 11:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [156ae689] Checking autorecoverable storage domains >2012-08-07 11:55:00,029 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [156ae689] Autorecovering 1 storage domains >2012-08-07 11:55:00,030 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [156ae689] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 11:55:00,032 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [7ed1efae] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:55:00,074 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [7ed1efae] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 11:55:00,122 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [7ed1efae] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 11:55:00,123 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-51) [7ed1efae] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 11:55 AM >2012-08-07 11:55:00,139 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-42) [7ed1efae] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 1497c883 >2012-08-07 11:55:51,705 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) Start time: 8/7/12 11:55 AM >2012-08-07 11:55:52,229 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (MSC service thread 1-2) Command [id=17f6ebeb-b9f0-41d3-b489-bd5c6d9e917a]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 11:55:52,303 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) Running compensation on startup for Command : org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand , Command Id : 17f6ebeb-b9f0-41d3-b489-bd5c6d9e917a >2012-08-07 11:55:52,418 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: CbcCheckOnVdsChange >2012-08-07 11:55:52,439 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: CAEngineKey >2012-08-07 11:55:52,440 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: ENGINEEARLib >2012-08-07 11:55:52,461 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: MinimalETLVersion >2012-08-07 11:55:52,509 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: ScriptsPath >2012-08-07 11:55:52,510 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: SQLServerI18NPrefix >2012-08-07 11:55:52,633 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (MSC service thread 1-2) Failed to decrypt Data must start with zero >2012-08-07 11:55:52,635 ERROR [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (MSC service thread 1-2) Failed to decrypt value for property TruststorePass will be used encrypted value >2012-08-07 11:55:52,735 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) VDSBrokerFrontend: 8/7/12 11:55 AM >2012-08-07 11:55:52,745 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) CpuFlagsManager: 8/7/12 11:55 AM >2012-08-07 11:55:52,750 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-2) Setting audit clean up manager to run at: 35 35 3 * * ? >2012-08-07 11:55:52,799 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) AuditLogCleanupManager: 8/7/12 11:55 AM >2012-08-07 11:55:52,807 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-2) TagsDirector initialization >2012-08-07 11:55:52,861 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-2) Tag root added to tree >2012-08-07 11:55:52,880 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) TagsDirector: 8/7/12 11:55 AM >2012-08-07 11:55:52,895 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) IsoDomainListSyncronizer: 8/7/12 11:55 AM >2012-08-07 11:55:52,938 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) InitHandlers: 8/7/12 11:55 AM >2012-08-07 11:55:52,959 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-2) Code VDS_FENCING_OPERATION_FAILED appears more then once in string table. >2012-08-07 11:55:52,964 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) ErrorTranslator: 8/7/12 11:55 AM >2012-08-07 11:55:52,965 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) VdsErrorTranslator: 8/7/12 11:55 AM >2012-08-07 11:55:52,970 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) Mark uncompleted jobs as UNKNOWN: 8/7/12 11:55 AM >2012-08-07 11:55:53,034 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) JobRepositoryCleanupManager: 8/7/12 11:55 AM >2012-08-07 11:55:53,040 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) AutoRecoveryManager: 8/7/12 11:55 AM >2012-08-07 11:55:53,045 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) ExecutionMessageDirector: 8/7/12 11:55 AM >2012-08-07 11:55:53,074 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (MSC service thread 1-2) UsersDomainsCacheManager: 8/7/12 11:55 AM >2012-08-07 11:55:53,083 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-1) InitResourceManager: 8/7/12 11:55 AM >2012-08-07 11:55:53,093 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-1) ResourceManager::ResourceManager::Entered >2012-08-07 11:55:53,177 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (MSC service thread 1-2) DbUserCacheManager: 8/7/12 11:55 AM >2012-08-07 11:55:53,286 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-1) DbUserCacheManager::refreshAllUserData() - entered >2012-08-07 11:55:58,527 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) Eneterd VdsManager:constructor >2012-08-07 11:55:58,530 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) vdsBroker(purple-vds3,54,321) >2012-08-07 11:55:58,736 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-1) ResourceManager::AddVds - VDS 47028088-dee6-11e1-bffa-2f8f15de3134 was added to the Resource Manager >2012-08-07 11:56:02,039 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: UNASSIGNED not exist in string table >2012-08-07 11:56:02,046 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table >2012-08-07 11:56:02,047 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: DWH_STOPPED not exist in string table >2012-08-07 11:56:02,048 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: DWH_STARTED not exist in string table >2012-08-07 11:56:02,048 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: DWH_ERROR not exist in string table >2012-08-07 11:56:02,055 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2012-08-07 11:56:02,056 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_FAILED_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2012-08-07 11:56:02,057 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2012-08-07 11:56:02,063 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_FAILED_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2012-08-07 11:56:03,741 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) Eneterd VdsManager:constructor >2012-08-07 11:56:03,742 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) vdsBroker(purple-vds2,54,321) >2012-08-07 11:56:03,749 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-1) ResourceManager::AddVds - VDS 4196a566-dee6-11e1-b66e-c35c5273fee7 was added to the Resource Manager >2012-08-07 11:56:03,822 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (MSC service thread 1-1) AsyncTaskManager: Initialization of AsyncTaskManager completed successfully. >2012-08-07 11:56:03,823 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-1) AsyncTaskManager: 8/7/12 11:56 AM >2012-08-07 11:56:03,826 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-1) VdsLoadBalancer: 8/7/12 11:56 AM >2012-08-07 11:56:03,834 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (pool-3-thread-4) MacPoolManager started: 8/7/12 11:56 AM >2012-08-07 11:56:04,037 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-2) Initializing Host: purple-vds3 >2012-08-07 11:56:04,223 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (pool-3-thread-4) MacPoolManager finished: 8/7/12 11:56 AM >2012-08-07 11:56:04,317 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-2) [33314445] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-07 11:56:07,101 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-3) Initializing Host: purple-vds2 >2012-08-07 11:56:07,118 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-3) [1da39115] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-07 11:56:13,955 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-13) [16bc40d1] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 7a858a05-d5d9-40de-9a4e-c24b1980eb23 Type: StoragePool >2012-08-07 11:56:13,963 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-15) [ef0e388] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-07 11:56:14,295 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-15) [ef0e388] hostFromVds::selectedVds - purple-vds2, spmStatus SPM, storage pool nfs31 >2012-08-07 11:56:14,296 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-13) [16bc40d1] hostFromVds::selectedVds - purple-vds3, spmStatus SPM, storage pool scsi >2012-08-07 11:56:14,349 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-15) [ef0e388] Initialize Irs proxy from vds: purple-vds2 >2012-08-07 11:56:14,366 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-13) [16bc40d1] Initialize Irs proxy from vds: purple-vds3 >2012-08-07 11:56:14,887 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-19) START, SPMGetAllTasksInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 3f9a9779 >2012-08-07 11:56:14,938 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) START, SPMGetAllTasksInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1e5dc997 >2012-08-07 11:56:15,073 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool 7a858a05-d5d9-40de-9a4e-c24b1980eb23 >2012-08-07 11:56:15,081 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) START, HSMGetAllTasksInfoVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134), log id: 6456ad90 >2012-08-07 11:56:15,089 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-19) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool efe20197-e0a7-49b8-beb4-19b1ed3f8c3f >2012-08-07 11:56:15,094 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-19) START, HSMGetAllTasksInfoVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7), log id: 3737740c >2012-08-07 11:56:15,177 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 6456ad90 >2012-08-07 11:56:15,178 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 1e5dc997 >2012-08-07 11:56:15,178 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-18) Discovered no tasks on Storage Pool scsi >2012-08-07 11:56:15,181 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-19) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 3737740c >2012-08-07 11:56:15,181 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-19) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 3f9a9779 >2012-08-07 11:56:15,182 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-19) Discovered no tasks on Storage Pool nfs31 >2012-08-07 11:56:44,490 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp--127.0.0.1-8009-2) [8e51c65] Running command: LogoutUserCommand internal: false. >2012-08-07 11:57:24,539 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-5) Checking if user admin@internal is an admin, result true >2012-08-07 11:57:24,540 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-5) Running command: LoginAdminUserCommand internal: false. >2012-08-07 11:57:25,925 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-34) VM pool1-13 6c1fcddf-86d6-4533-905b-abb11b775f5b moved from PoweringDown --> Up >2012-08-07 11:57:25,991 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-34) VM pool1-12 e5a192f1-3f9d-48e1-a817-28f72815c646 moved from PoweringDown --> Up >2012-08-07 11:57:26,022 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-34) VM pool1-10 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 moved from PoweringDown --> Up >2012-08-07 11:57:26,056 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-34) VM pool1-11 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 moved from PoweringDown --> Up >2012-08-07 11:57:28,260 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-38) VM pool1-14 2842672f-6230-434f-8232-e88e71560092 moved from PoweringDown --> Up >2012-08-07 11:57:28,473 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-8) Adding new value to configuration cache. >2012-08-07 11:57:28,480 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-8) Didnt find the value of DBPagingType in DB for version general - using default: Offset >2012-08-07 11:57:28,481 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-8) Adding new value to configuration cache. >2012-08-07 11:57:28,482 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-8) Didnt find the value of DBPagingSyntax in DB for version general - using default: OFFSET (%1$s -1) LIMIT %2$s >2012-08-07 11:57:28,489 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-8) Adding new value to configuration cache. >2012-08-07 11:57:28,490 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-8) Didnt find the value of DBSearchTemplate in DB for version general - using default: SELECT * FROM (%2$s) %1$s) as T1 %3$s >2012-08-07 11:59:01,415 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-95) VM new ba81adbe-b311-4aef-b6c1-5f84f0f3c94d moved from PoweringDown --> Up >2012-08-07 11:59:01,520 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-95) VM lesik 54b872c6-cefc-4a19-b48e-9bc1a09285f9 moved from PoweringDown --> Up >2012-08-07 11:59:02,007 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) Start time: 8/7/12 11:59 AM. Start running CanDoAction for command number 1/5 (Command type: ShutdownVm) >2012-08-07 11:59:02,012 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/7/12 11:59 AM. Start running CanDoAction for command number 2/5 (Command type: ShutdownVm) >2012-08-07 11:59:02,026 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) Start time: 8/7/12 11:59 AM. Start running CanDoAction for command number 3/5 (Command type: ShutdownVm) >2012-08-07 11:59:02,032 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/7/12 11:59 AM. Start running CanDoAction for command number 4/5 (Command type: ShutdownVm) >2012-08-07 11:59:02,037 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/7/12 11:59 AM. Start running CanDoAction for command number 5/5 (Command type: ShutdownVm) >2012-08-07 11:59:02,087 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/7/12 11:59 AM. Finish handling CanDoAction for command number 2/5 (Command type: ShutdownVm) >2012-08-07 11:59:02,088 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) End time: 8/7/12 11:59 AM. Finish handling CanDoAction for command number 1/5 (Command type: ShutdownVm) >2012-08-07 11:59:02,088 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) End time: 8/7/12 11:59 AM. Finish handling CanDoAction for command number 3/5 (Command type: ShutdownVm) >2012-08-07 11:59:02,182 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/7/12 11:59 AM. Finish handling CanDoAction for command number 5/5 (Command type: ShutdownVm) >2012-08-07 11:59:02,218 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/7/12 11:59 AM. Finish handling CanDoAction for command number 4/5 (Command type: ShutdownVm) >2012-08-07 11:59:02,344 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [e6cd09] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 Type: VM >2012-08-07 11:59:02,347 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [e6cd09] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-10). >2012-08-07 11:59:02,348 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [e6cd09] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-10. >2012-08-07 11:59:02,360 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [e6cd09] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, force=false, secondsToWait=30, gracefully=true), log id: 71cf5d2 >2012-08-07 11:59:02,371 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [e6cd09] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, force=false, secondsToWait=30, gracefully=true), log id: 549123d2 >2012-08-07 11:59:02,444 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [e6cd09] FINISH, DestroyVDSCommand, log id: 549123d2 >2012-08-07 11:59:02,473 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [e6cd09] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 71cf5d2 >2012-08-07 11:59:02,606 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [1c5d193c] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 Type: VM >2012-08-07 11:59:02,613 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [1c5d193c] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-11). >2012-08-07 11:59:02,617 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [1c5d193c] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-11. >2012-08-07 11:59:02,618 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [1c5d193c] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42, force=false, secondsToWait=30, gracefully=true), log id: 33dab414 >2012-08-07 11:59:02,628 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [1c5d193c] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42, force=false, secondsToWait=30, gracefully=true), log id: 661ac38 >2012-08-07 11:59:02,715 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [1c5d193c] FINISH, DestroyVDSCommand, log id: 661ac38 >2012-08-07 11:59:02,754 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [1c5d193c] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 33dab414 >2012-08-07 11:59:02,956 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [2423c0b0] Running command: ShutdownVmCommand internal: false. Entities affected : ID: e5a192f1-3f9d-48e1-a817-28f72815c646 Type: VM >2012-08-07 11:59:02,960 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [2423c0b0] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-12). >2012-08-07 11:59:02,965 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [2423c0b0] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-12. >2012-08-07 11:59:02,967 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [2423c0b0] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, force=false, secondsToWait=30, gracefully=true), log id: 62f210d4 >2012-08-07 11:59:02,978 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [2423c0b0] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, force=false, secondsToWait=30, gracefully=true), log id: 3b5e34e2 >2012-08-07 11:59:03,045 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [2423c0b0] FINISH, DestroyVDSCommand, log id: 3b5e34e2 >2012-08-07 11:59:03,181 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [2423c0b0] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 62f210d4 >2012-08-07 11:59:03,398 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [273f7559] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 6c1fcddf-86d6-4533-905b-abb11b775f5b Type: VM >2012-08-07 11:59:03,400 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [273f7559] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-13). >2012-08-07 11:59:03,401 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [273f7559] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-13. >2012-08-07 11:59:03,402 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [273f7559] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, force=false, secondsToWait=30, gracefully=true), log id: 262f5281 >2012-08-07 11:59:03,414 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [273f7559] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, force=false, secondsToWait=30, gracefully=true), log id: 115e1737 >2012-08-07 11:59:03,484 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [273f7559] FINISH, DestroyVDSCommand, log id: 115e1737 >2012-08-07 11:59:03,512 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [273f7559] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 262f5281 >2012-08-07 11:59:03,667 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [37313a30] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 2842672f-6230-434f-8232-e88e71560092 Type: VM >2012-08-07 11:59:03,670 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [37313a30] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-14). >2012-08-07 11:59:03,671 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [37313a30] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-14. >2012-08-07 11:59:03,672 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [37313a30] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, force=false, secondsToWait=30, gracefully=true), log id: 74ec3f85 >2012-08-07 11:59:03,855 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [37313a30] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, force=false, secondsToWait=30, gracefully=true), log id: 2678417e >2012-08-07 11:59:03,918 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [37313a30] FINISH, DestroyVDSCommand, log id: 2678417e >2012-08-07 11:59:03,952 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [37313a30] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 74ec3f85 >2012-08-07 12:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable hosts >2012-08-07 12:00:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Autorecovering 0 hosts >2012-08-07 12:00:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable hosts done >2012-08-07 12:00:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable storage domains >2012-08-07 12:00:00,065 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Autorecovering 1 storage domains >2012-08-07 12:00:00,066 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 12:00:00,093 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [4ee0d943] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:00:00,181 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [4ee0d943] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 12:00:00,276 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [4ee0d943] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:00:00,281 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [4ee0d943] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:00 PM >2012-08-07 12:00:00,300 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (QuartzScheduler_Worker-92) [4ee0d943] Adding new value to configuration cache. >2012-08-07 12:00:00,301 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (QuartzScheduler_Worker-92) [4ee0d943] Didnt find the value of DBI18NPrefix in DB for version general - using default: >2012-08-07 12:00:00,360 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [4ee0d943] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 2c0b9005 >2012-08-07 12:03:00,388 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [4ee0d943] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 12:03:00,390 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [4ee0d943] FINISH, ConnectStorageServerVDSCommand, log id: 2c0b9005 >2012-08-07 12:03:00,392 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [4ee0d943] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 12:03:00,401 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [4ee0d943] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:03 PM >2012-08-07 12:03:00,402 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-92) [4ee0d943] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 500c6a46 >2012-08-07 12:03:00,664 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-92) [4ee0d943] Failed in ActivateStorageDomainVDS method >2012-08-07 12:03:00,667 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-92) [4ee0d943] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:03:00,668 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-92) [4ee0d943] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:03:00,674 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-92) [4ee0d943] FINISH, ActivateStorageDomainVDSCommand, log id: 500c6a46 >2012-08-07 12:03:00,675 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [4ee0d943] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:03:00,700 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-92) [4ee0d943] Command [id=7edc3d3f-51ce-4d05-9a4c-cf71f4436261]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 12:03:00,728 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) [4ee0d943] Checking autorecoverable storage domains done >2012-08-07 12:04:02,688 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-3) [1da39115] VM pool1-10 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 moved from PoweringDown --> Up >2012-08-07 12:04:02,714 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-3) [1da39115] VM pool1-11 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 moved from PoweringDown --> Up >2012-08-07 12:04:04,870 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-14) VM pool1-13 6c1fcddf-86d6-4533-905b-abb11b775f5b moved from PoweringDown --> Up >2012-08-07 12:04:04,900 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-14) VM pool1-14 2842672f-6230-434f-8232-e88e71560092 moved from PoweringDown --> Up >2012-08-07 12:04:04,919 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-14) VM pool1-12 e5a192f1-3f9d-48e1-a817-28f72815c646 moved from PoweringDown --> Up >2012-08-07 12:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable hosts >2012-08-07 12:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Autorecovering 0 hosts >2012-08-07 12:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable hosts done >2012-08-07 12:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable storage domains >2012-08-07 12:05:00,034 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Autorecovering 1 storage domains >2012-08-07 12:05:00,035 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 12:05:00,038 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-100) [21c54459] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:05:00,111 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-100) [21c54459] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 12:05:00,176 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-100) [21c54459] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:05:00,177 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-100) [21c54459] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:05 PM >2012-08-07 12:05:00,229 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [21c54459] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 253169f0 >2012-08-07 12:08:00,233 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [21c54459] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 12:08:00,234 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [21c54459] FINISH, ConnectStorageServerVDSCommand, log id: 253169f0 >2012-08-07 12:08:00,235 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [21c54459] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 12:08:00,251 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-100) [21c54459] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:08 PM >2012-08-07 12:08:00,252 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-100) [21c54459] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 42cab21a >2012-08-07 12:08:00,516 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-100) [21c54459] Failed in ActivateStorageDomainVDS method >2012-08-07 12:08:00,517 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-100) [21c54459] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:08:00,518 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-100) [21c54459] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:08:00,526 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-100) [21c54459] FINISH, ActivateStorageDomainVDSCommand, log id: 42cab21a >2012-08-07 12:08:00,526 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-100) [21c54459] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:08:00,545 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-100) [21c54459] Command [id=a6e47657-74fd-4692-9155-dbb0c794f348]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 12:08:00,563 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) [21c54459] Checking autorecoverable storage domains done >2012-08-07 12:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable hosts >2012-08-07 12:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering 0 hosts >2012-08-07 12:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable hosts done >2012-08-07 12:10:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable storage domains >2012-08-07 12:10:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering 1 storage domains >2012-08-07 12:10:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 12:10:00,029 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [46ea31e4] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:10:00,117 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [46ea31e4] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 12:10:00,157 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [46ea31e4] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:10:00,158 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [46ea31e4] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:10 PM >2012-08-07 12:10:00,177 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [46ea31e4] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 40c7038f >2012-08-07 12:13:00,181 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-46) [46ea31e4] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 12:13:00,189 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [46ea31e4] FINISH, ConnectStorageServerVDSCommand, log id: 40c7038f >2012-08-07 12:13:00,190 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-46) [46ea31e4] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 12:13:00,206 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [46ea31e4] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:13 PM >2012-08-07 12:13:00,208 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-22) [46ea31e4] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 14f4e7e8 >2012-08-07 12:13:00,468 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-22) [46ea31e4] Failed in ActivateStorageDomainVDS method >2012-08-07 12:13:00,469 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-22) [46ea31e4] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:13:00,470 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) [46ea31e4] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:13:00,473 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-22) [46ea31e4] FINISH, ActivateStorageDomainVDSCommand, log id: 14f4e7e8 >2012-08-07 12:13:00,474 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [46ea31e4] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:13:00,488 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [46ea31e4] Command [id=f812a3de-038a-4ed0-8729-706dbcbdf1d7]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 12:13:00,504 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) [46ea31e4] Checking autorecoverable storage domains done >2012-08-07 12:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable hosts >2012-08-07 12:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Autorecovering 0 hosts >2012-08-07 12:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable hosts done >2012-08-07 12:15:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable storage domains >2012-08-07 12:15:00,033 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Autorecovering 1 storage domains >2012-08-07 12:15:00,033 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 12:15:00,036 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-43) [697bb8b4] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:15:00,076 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-43) [697bb8b4] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 12:15:00,129 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-43) [697bb8b4] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:15:00,130 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-43) [697bb8b4] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:15 PM >2012-08-07 12:15:00,163 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [697bb8b4] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 5f74332e >2012-08-07 12:18:00,175 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [697bb8b4] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 12:18:00,177 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [697bb8b4] FINISH, ConnectStorageServerVDSCommand, log id: 5f74332e >2012-08-07 12:18:00,178 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [697bb8b4] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 12:18:00,184 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-43) [697bb8b4] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:18 PM >2012-08-07 12:18:00,185 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-43) [697bb8b4] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 3f3f47b9 >2012-08-07 12:18:00,451 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-43) [697bb8b4] Failed in ActivateStorageDomainVDS method >2012-08-07 12:18:00,451 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-43) [697bb8b4] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:18:00,452 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-43) [697bb8b4] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:18:00,458 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-43) [697bb8b4] FINISH, ActivateStorageDomainVDSCommand, log id: 3f3f47b9 >2012-08-07 12:18:00,458 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-43) [697bb8b4] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:18:00,476 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-43) [697bb8b4] Command [id=7cc9588d-014e-4372-9b83-48b6a63f868a]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 12:18:00,492 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) [697bb8b4] Checking autorecoverable storage domains done >2012-08-07 12:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) Checking autorecoverable hosts >2012-08-07 12:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) Autorecovering 0 hosts >2012-08-07 12:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) Checking autorecoverable hosts done >2012-08-07 12:20:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) Checking autorecoverable storage domains >2012-08-07 12:20:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) Autorecovering 1 storage domains >2012-08-07 12:20:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 12:20:00,033 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [3d8b6e0e] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:20:00,072 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [3d8b6e0e] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 12:20:00,124 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [3d8b6e0e] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:20:00,125 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [3d8b6e0e] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:20 PM >2012-08-07 12:20:00,142 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [3d8b6e0e] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 26006eb6 >2012-08-07 12:20:52,026 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-15) Checking if user admin@internal is an admin, result true >2012-08-07 12:20:52,027 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-15) Running command: LoginAdminUserCommand internal: false. >2012-08-07 12:23:00,146 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-46) [3d8b6e0e] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 12:23:00,147 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [3d8b6e0e] FINISH, ConnectStorageServerVDSCommand, log id: 26006eb6 >2012-08-07 12:23:00,148 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-46) [3d8b6e0e] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 12:23:00,163 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [3d8b6e0e] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:23 PM >2012-08-07 12:23:00,164 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-66) [3d8b6e0e] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 6e85d818 >2012-08-07 12:23:00,472 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-66) [3d8b6e0e] Failed in ActivateStorageDomainVDS method >2012-08-07 12:23:00,473 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-66) [3d8b6e0e] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:23:00,474 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-66) [3d8b6e0e] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:23:00,476 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-66) [3d8b6e0e] FINISH, ActivateStorageDomainVDSCommand, log id: 6e85d818 >2012-08-07 12:23:00,477 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [3d8b6e0e] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:23:00,489 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-66) [3d8b6e0e] Command [id=1f4295d7-dfcd-450c-8ea3-09962dc20723]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 12:23:00,507 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [3d8b6e0e] Checking autorecoverable storage domains done >2012-08-07 12:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable hosts >2012-08-07 12:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Autorecovering 0 hosts >2012-08-07 12:25:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable hosts done >2012-08-07 12:25:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable storage domains >2012-08-07 12:25:00,066 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Autorecovering 1 storage domains >2012-08-07 12:25:00,066 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 12:25:00,069 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [3a68b3ab] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:25:00,182 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [3a68b3ab] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 12:25:00,212 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [3a68b3ab] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:25:00,213 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [3a68b3ab] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:25 PM >2012-08-07 12:25:00,251 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [3a68b3ab] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 4c4aa30d >2012-08-07 12:28:00,258 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-46) [3a68b3ab] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 12:28:00,260 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [3a68b3ab] FINISH, ConnectStorageServerVDSCommand, log id: 4c4aa30d >2012-08-07 12:28:00,261 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-46) [3a68b3ab] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 12:28:00,272 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [3a68b3ab] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:28 PM >2012-08-07 12:28:00,274 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-79) [3a68b3ab] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 771aa96 >2012-08-07 12:28:00,538 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-79) [3a68b3ab] Failed in ActivateStorageDomainVDS method >2012-08-07 12:28:00,538 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-79) [3a68b3ab] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:28:00,539 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-79) [3a68b3ab] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:28:00,544 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-79) [3a68b3ab] FINISH, ActivateStorageDomainVDSCommand, log id: 771aa96 >2012-08-07 12:28:00,544 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [3a68b3ab] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:28:00,555 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-79) [3a68b3ab] Command [id=c59a190b-e816-4c25-b495-1c97f8ff0a8f]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 12:28:00,575 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) [3a68b3ab] Checking autorecoverable storage domains done >2012-08-07 12:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Checking autorecoverable hosts >2012-08-07 12:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Autorecovering 0 hosts >2012-08-07 12:30:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Checking autorecoverable hosts done >2012-08-07 12:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Checking autorecoverable storage domains >2012-08-07 12:30:00,081 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Autorecovering 1 storage domains >2012-08-07 12:30:00,084 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 12:30:00,088 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [57e9cf1a] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:30:00,147 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [57e9cf1a] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 12:30:00,188 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [57e9cf1a] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:30:00,189 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [57e9cf1a] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:30 PM >2012-08-07 12:30:00,205 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [57e9cf1a] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 55677cd9 >2012-08-07 12:33:00,210 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-46) [57e9cf1a] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 12:33:00,211 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [57e9cf1a] FINISH, ConnectStorageServerVDSCommand, log id: 55677cd9 >2012-08-07 12:33:00,213 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-46) [57e9cf1a] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 12:33:00,219 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [57e9cf1a] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:33 PM >2012-08-07 12:33:00,220 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-16) [57e9cf1a] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 48116d5a >2012-08-07 12:33:00,471 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-16) [57e9cf1a] Failed in ActivateStorageDomainVDS method >2012-08-07 12:33:00,472 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-16) [57e9cf1a] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:33:00,473 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [57e9cf1a] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:33:00,476 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-16) [57e9cf1a] FINISH, ActivateStorageDomainVDSCommand, log id: 48116d5a >2012-08-07 12:33:00,476 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [57e9cf1a] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:33:00,488 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-16) [57e9cf1a] Command [id=15cfce74-00d4-4c16-a612-4aef25e16d43]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 12:33:00,511 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) [57e9cf1a] Checking autorecoverable storage domains done >2012-08-07 12:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Checking autorecoverable hosts >2012-08-07 12:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Autorecovering 0 hosts >2012-08-07 12:35:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Checking autorecoverable hosts done >2012-08-07 12:35:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Checking autorecoverable storage domains >2012-08-07 12:35:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Autorecovering 1 storage domains >2012-08-07 12:35:00,026 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 12:35:00,028 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [14a40e4e] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:35:00,082 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [14a40e4e] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 12:35:00,107 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [14a40e4e] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:35:00,108 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [14a40e4e] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:35 PM >2012-08-07 12:35:00,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [14a40e4e] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 34c43645 >2012-08-07 12:38:00,130 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [14a40e4e] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 12:38:00,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [14a40e4e] FINISH, ConnectStorageServerVDSCommand, log id: 34c43645 >2012-08-07 12:38:00,131 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [14a40e4e] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 12:38:00,137 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [14a40e4e] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:38 PM >2012-08-07 12:38:00,138 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-35) [14a40e4e] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 15be4f76 >2012-08-07 12:38:00,389 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-35) [14a40e4e] Failed in ActivateStorageDomainVDS method >2012-08-07 12:38:00,390 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-35) [14a40e4e] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:38:00,390 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-35) [14a40e4e] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:38:00,398 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-35) [14a40e4e] FINISH, ActivateStorageDomainVDSCommand, log id: 15be4f76 >2012-08-07 12:38:00,399 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [14a40e4e] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:38:00,411 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [14a40e4e] Command [id=ef25f31d-6fa8-4f0e-bdce-bcd9e598434e]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 12:38:00,564 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [14a40e4e] Checking autorecoverable storage domains done >2012-08-07 12:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Checking autorecoverable hosts >2012-08-07 12:40:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Autorecovering 0 hosts >2012-08-07 12:40:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Checking autorecoverable hosts done >2012-08-07 12:40:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Checking autorecoverable storage domains >2012-08-07 12:40:00,044 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Autorecovering 1 storage domains >2012-08-07 12:40:00,044 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 12:40:00,046 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [327fd789] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:40:00,077 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [327fd789] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 12:40:00,099 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [327fd789] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:40:00,100 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [327fd789] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:40 PM >2012-08-07 12:40:00,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [327fd789] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 3a3ae668 >2012-08-07 12:43:00,129 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [327fd789] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 12:43:00,130 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [327fd789] FINISH, ConnectStorageServerVDSCommand, log id: 3a3ae668 >2012-08-07 12:43:00,130 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [327fd789] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 12:43:00,137 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [327fd789] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:43 PM >2012-08-07 12:43:00,138 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-42) [327fd789] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 527aa183 >2012-08-07 12:43:00,391 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-42) [327fd789] Failed in ActivateStorageDomainVDS method >2012-08-07 12:43:00,392 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-42) [327fd789] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:43:00,393 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) [327fd789] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:43:00,395 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-42) [327fd789] FINISH, ActivateStorageDomainVDSCommand, log id: 527aa183 >2012-08-07 12:43:00,396 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [327fd789] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:43:00,407 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-42) [327fd789] Command [id=4ef7faab-3136-4f00-8997-3cfc4bff59aa]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 12:43:00,492 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [327fd789] Checking autorecoverable storage domains done >2012-08-07 12:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) Checking autorecoverable hosts >2012-08-07 12:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) Autorecovering 0 hosts >2012-08-07 12:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) Checking autorecoverable hosts done >2012-08-07 12:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) Checking autorecoverable storage domains >2012-08-07 12:45:00,035 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) Autorecovering 1 storage domains >2012-08-07 12:45:00,036 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 12:45:00,038 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-63) [46156fdb] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:45:00,069 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-63) [46156fdb] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 12:45:00,128 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-63) [46156fdb] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:45:00,130 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-63) [46156fdb] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:45 PM >2012-08-07 12:45:00,143 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [46156fdb] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 313e2883 >2012-08-07 12:48:00,147 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-46) [46156fdb] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 12:48:00,148 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [46156fdb] FINISH, ConnectStorageServerVDSCommand, log id: 313e2883 >2012-08-07 12:48:00,149 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-46) [46156fdb] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 12:48:00,156 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-63) [46156fdb] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:48 PM >2012-08-07 12:48:00,157 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-63) [46156fdb] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 639ab1ba >2012-08-07 12:48:00,413 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-63) [46156fdb] Failed in ActivateStorageDomainVDS method >2012-08-07 12:48:00,414 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-63) [46156fdb] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:48:00,415 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-63) [46156fdb] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:48:00,418 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-63) [46156fdb] FINISH, ActivateStorageDomainVDSCommand, log id: 639ab1ba >2012-08-07 12:48:00,419 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-63) [46156fdb] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:48:00,428 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-63) [46156fdb] Command [id=6cf4f01d-4177-4a39-9bb6-534ee086f0f7]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 12:48:00,458 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) [46156fdb] Checking autorecoverable storage domains done >2012-08-07 12:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts >2012-08-07 12:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering 0 hosts >2012-08-07 12:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts done >2012-08-07 12:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable storage domains >2012-08-07 12:50:00,185 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering 1 storage domains >2012-08-07 12:50:00,186 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 12:50:00,195 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-98) [720c87d3] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:50:00,448 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-98) [720c87d3] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 12:50:00,474 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-98) [720c87d3] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:50:00,476 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-98) [720c87d3] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:50 PM >2012-08-07 12:50:00,489 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [720c87d3] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 5e900ae3 >2012-08-07 12:53:00,492 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [720c87d3] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 12:53:00,493 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [720c87d3] FINISH, ConnectStorageServerVDSCommand, log id: 5e900ae3 >2012-08-07 12:53:00,494 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [720c87d3] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 12:53:00,500 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-98) [720c87d3] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:53 PM >2012-08-07 12:53:00,501 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-98) [720c87d3] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: b255568 >2012-08-07 12:53:00,753 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-98) [720c87d3] Failed in ActivateStorageDomainVDS method >2012-08-07 12:53:00,754 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-98) [720c87d3] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:53:00,755 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-98) [720c87d3] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:53:00,760 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-98) [720c87d3] FINISH, ActivateStorageDomainVDSCommand, log id: b255568 >2012-08-07 12:53:00,761 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-98) [720c87d3] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:53:00,773 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-98) [720c87d3] Command [id=7c2b7559-d71c-4723-a551-55cc3c5bd464]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 12:53:00,790 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) [720c87d3] Checking autorecoverable storage domains done >2012-08-07 12:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable hosts >2012-08-07 12:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Autorecovering 0 hosts >2012-08-07 12:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable hosts done >2012-08-07 12:55:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable storage domains >2012-08-07 12:55:00,223 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Autorecovering 1 storage domains >2012-08-07 12:55:00,224 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 12:55:00,227 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-20) [6945d555] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:55:00,267 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-20) [6945d555] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 12:55:00,287 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-20) [6945d555] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 12:55:00,288 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-20) [6945d555] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 12:55 PM >2012-08-07 12:55:00,301 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [6945d555] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 31ba47eb >2012-08-07 12:55:53,308 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-98) [720c87d3] DbUserCacheManager::refreshAllUserData() - entered >2012-08-07 12:55:53,332 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp--127.0.0.1-8009-22) [34a162f1] Running command: LogoutUserCommand internal: false. >2012-08-07 12:55:53,383 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp--127.0.0.1-8009-2) [2ee212d4] Running command: LogoutUserCommand internal: false. >2012-08-07 12:58:00,305 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [6945d555] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 12:58:00,307 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [6945d555] FINISH, ConnectStorageServerVDSCommand, log id: 31ba47eb >2012-08-07 12:58:00,308 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [6945d555] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 12:58:00,323 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-20) [6945d555] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 12:58 PM >2012-08-07 12:58:00,329 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-20) [6945d555] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 2d25a4bc >2012-08-07 12:58:00,628 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-20) [6945d555] Failed in ActivateStorageDomainVDS method >2012-08-07 12:58:00,629 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-20) [6945d555] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:58:00,630 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) [6945d555] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:58:00,632 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-20) [6945d555] FINISH, ActivateStorageDomainVDSCommand, log id: 2d25a4bc >2012-08-07 12:58:00,633 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-20) [6945d555] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 12:58:00,644 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-20) [6945d555] Command [id=65e6db4d-13fc-47ff-982d-9f56001bd5fc]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 12:58:00,662 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) [6945d555] Checking autorecoverable storage domains done >2012-08-07 13:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Checking autorecoverable hosts >2012-08-07 13:00:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Autorecovering 0 hosts >2012-08-07 13:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Checking autorecoverable hosts done >2012-08-07 13:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Checking autorecoverable storage domains >2012-08-07 13:00:00,142 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Autorecovering 1 storage domains >2012-08-07 13:00:00,143 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 13:00:00,145 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [67994dbd] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:00:00,221 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [67994dbd] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 13:00:00,268 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [67994dbd] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:00:00,269 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [67994dbd] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:00 PM >2012-08-07 13:00:00,284 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [67994dbd] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 3f14889d >2012-08-07 13:03:00,287 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [67994dbd] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 13:03:00,288 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [67994dbd] FINISH, ConnectStorageServerVDSCommand, log id: 3f14889d >2012-08-07 13:03:00,289 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [67994dbd] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 13:03:00,295 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [67994dbd] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:03 PM >2012-08-07 13:03:00,296 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-29) [67994dbd] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 13b54efa >2012-08-07 13:03:00,575 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-29) [67994dbd] Failed in ActivateStorageDomainVDS method >2012-08-07 13:03:00,575 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-29) [67994dbd] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:03:00,576 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-29) [67994dbd] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:03:00,579 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-29) [67994dbd] FINISH, ActivateStorageDomainVDSCommand, log id: 13b54efa >2012-08-07 13:03:00,580 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [67994dbd] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:03:00,600 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-29) [67994dbd] Command [id=80543412-1e69-47cb-8f9b-8256dd74a17b]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 13:03:00,619 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [67994dbd] Checking autorecoverable storage domains done >2012-08-07 13:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable hosts >2012-08-07 13:05:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Autorecovering 0 hosts >2012-08-07 13:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable hosts done >2012-08-07 13:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable storage domains >2012-08-07 13:05:00,153 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Autorecovering 1 storage domains >2012-08-07 13:05:00,155 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 13:05:00,157 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [38f7d324] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:05:00,258 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [38f7d324] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 13:05:00,313 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [38f7d324] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:05:00,313 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [38f7d324] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:05 PM >2012-08-07 13:05:00,327 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [38f7d324] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 1b660fa7 >2012-08-07 13:08:00,332 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [38f7d324] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 13:08:00,333 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [38f7d324] FINISH, ConnectStorageServerVDSCommand, log id: 1b660fa7 >2012-08-07 13:08:00,333 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [38f7d324] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 13:08:00,340 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [38f7d324] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:08 PM >2012-08-07 13:08:00,341 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-74) [38f7d324] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 43fb86c4 >2012-08-07 13:08:00,630 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-74) [38f7d324] Failed in ActivateStorageDomainVDS method >2012-08-07 13:08:00,630 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-74) [38f7d324] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:08:00,631 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [38f7d324] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:08:00,634 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-74) [38f7d324] FINISH, ActivateStorageDomainVDSCommand, log id: 43fb86c4 >2012-08-07 13:08:00,634 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [38f7d324] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:08:00,646 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-74) [38f7d324] Command [id=1fb71370-a88e-49a7-9dfb-0861c4fc7666]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 13:08:00,682 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) [38f7d324] Checking autorecoverable storage domains done >2012-08-07 13:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable hosts >2012-08-07 13:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Autorecovering 0 hosts >2012-08-07 13:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable hosts done >2012-08-07 13:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Checking autorecoverable storage domains >2012-08-07 13:10:00,233 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Autorecovering 1 storage domains >2012-08-07 13:10:00,233 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 13:10:00,236 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-76) [28adf3ec] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:10:00,382 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-76) [28adf3ec] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 13:10:00,410 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-76) [28adf3ec] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:10:00,411 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-76) [28adf3ec] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:10 PM >2012-08-07 13:10:00,424 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [28adf3ec] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 4fbcddac >2012-08-07 13:13:00,428 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [28adf3ec] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 13:13:00,428 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [28adf3ec] FINISH, ConnectStorageServerVDSCommand, log id: 4fbcddac >2012-08-07 13:13:00,429 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [28adf3ec] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 13:13:00,437 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-76) [28adf3ec] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:13 PM >2012-08-07 13:13:00,438 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-76) [28adf3ec] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 6e14261d >2012-08-07 13:13:00,714 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-76) [28adf3ec] Failed in ActivateStorageDomainVDS method >2012-08-07 13:13:00,715 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-76) [28adf3ec] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:13:00,715 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-76) [28adf3ec] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:13:00,718 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-76) [28adf3ec] FINISH, ActivateStorageDomainVDSCommand, log id: 6e14261d >2012-08-07 13:13:00,718 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-76) [28adf3ec] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:13:00,730 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-76) [28adf3ec] Command [id=c334e2e0-0cf1-45a4-97d4-1065827727cc]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 13:13:00,776 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) [28adf3ec] Checking autorecoverable storage domains done >2012-08-07 13:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Checking autorecoverable hosts >2012-08-07 13:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Autorecovering 0 hosts >2012-08-07 13:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Checking autorecoverable hosts done >2012-08-07 13:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Checking autorecoverable storage domains >2012-08-07 13:15:00,150 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Autorecovering 1 storage domains >2012-08-07 13:15:00,150 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 13:15:00,153 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-87) [30e11fa4] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:15:00,289 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-87) [30e11fa4] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 13:15:00,353 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-87) [30e11fa4] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:15:00,354 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-87) [30e11fa4] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:15 PM >2012-08-07 13:15:00,368 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [30e11fa4] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: c2fd83a >2012-08-07 13:18:00,373 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [30e11fa4] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 13:18:00,374 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [30e11fa4] FINISH, ConnectStorageServerVDSCommand, log id: c2fd83a >2012-08-07 13:18:00,374 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [30e11fa4] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 13:18:00,381 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-87) [30e11fa4] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:18 PM >2012-08-07 13:18:00,383 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-87) [30e11fa4] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 5acf6696 >2012-08-07 13:18:00,637 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-87) [30e11fa4] Failed in ActivateStorageDomainVDS method >2012-08-07 13:18:00,638 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-87) [30e11fa4] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:18:00,639 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) [30e11fa4] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:18:00,642 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-87) [30e11fa4] FINISH, ActivateStorageDomainVDSCommand, log id: 5acf6696 >2012-08-07 13:18:00,642 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-87) [30e11fa4] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:18:00,649 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-87) [30e11fa4] Command [id=3495dc9e-8b5f-425b-a78f-b3ae19bdac5f]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 13:18:00,682 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) [30e11fa4] Checking autorecoverable storage domains done >2012-08-07 13:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) [1da39115] Checking autorecoverable hosts >2012-08-07 13:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) [1da39115] Autorecovering 0 hosts >2012-08-07 13:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) [1da39115] Checking autorecoverable hosts done >2012-08-07 13:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) [1da39115] Checking autorecoverable storage domains >2012-08-07 13:20:00,250 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) [1da39115] Autorecovering 1 storage domains >2012-08-07 13:20:00,250 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) [1da39115] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 13:20:00,253 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-3) [33fd209b] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:20:00,327 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-3) [33fd209b] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 13:20:00,362 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-3) [33fd209b] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:20:00,363 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-3) [33fd209b] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:20 PM >2012-08-07 13:20:00,376 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [33fd209b] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 58c745cb >2012-08-07 13:22:30,618 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-17) Checking if user admin@internal is an admin, result true >2012-08-07 13:22:30,620 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-17) Running command: LoginAdminUserCommand internal: false. >2012-08-07 13:23:00,380 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [33fd209b] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 13:23:00,381 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [33fd209b] FINISH, ConnectStorageServerVDSCommand, log id: 58c745cb >2012-08-07 13:23:00,381 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [33fd209b] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 13:23:00,387 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-3) [33fd209b] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:23 PM >2012-08-07 13:23:00,388 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-3) [33fd209b] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 4f45c724 >2012-08-07 13:23:00,656 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-3) [33fd209b] Failed in ActivateStorageDomainVDS method >2012-08-07 13:23:00,657 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-3) [33fd209b] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:23:00,658 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-3) [33fd209b] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:23:00,660 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-3) [33fd209b] FINISH, ActivateStorageDomainVDSCommand, log id: 4f45c724 >2012-08-07 13:23:00,661 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-3) [33fd209b] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:23:00,673 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-3) [33fd209b] Command [id=7de13750-f5da-4528-842d-ed7994a230fd]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 13:23:00,697 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) [33fd209b] Checking autorecoverable storage domains done >2012-08-07 13:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable hosts >2012-08-07 13:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Autorecovering 0 hosts >2012-08-07 13:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable hosts done >2012-08-07 13:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable storage domains >2012-08-07 13:25:00,290 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Autorecovering 1 storage domains >2012-08-07 13:25:00,290 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 13:25:00,293 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-48) [13d235d5] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:25:00,539 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-48) [13d235d5] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 13:25:00,590 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-48) [13d235d5] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:25:00,591 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-48) [13d235d5] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:25 PM >2012-08-07 13:25:00,604 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [13d235d5] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 42cb7e6e >2012-08-07 13:28:00,607 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-50) [13d235d5] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 13:28:00,611 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [13d235d5] FINISH, ConnectStorageServerVDSCommand, log id: 42cb7e6e >2012-08-07 13:28:00,612 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-50) [13d235d5] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 13:28:00,626 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-48) [13d235d5] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:28 PM >2012-08-07 13:28:00,627 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-48) [13d235d5] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 66efdda >2012-08-07 13:28:00,891 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-48) [13d235d5] Failed in ActivateStorageDomainVDS method >2012-08-07 13:28:00,891 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-48) [13d235d5] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:28:00,894 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-48) [13d235d5] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:28:00,897 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-48) [13d235d5] FINISH, ActivateStorageDomainVDSCommand, log id: 66efdda >2012-08-07 13:28:00,897 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-48) [13d235d5] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:28:00,910 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-48) [13d235d5] Command [id=d89d933a-014b-4eb3-ad7d-d3b7b94f7e2d]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 13:28:00,941 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) [13d235d5] Checking autorecoverable storage domains done >2012-08-07 13:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) [697bb8b4] Checking autorecoverable hosts >2012-08-07 13:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) [697bb8b4] Autorecovering 0 hosts >2012-08-07 13:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) [697bb8b4] Checking autorecoverable hosts done >2012-08-07 13:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) [697bb8b4] Checking autorecoverable storage domains >2012-08-07 13:30:00,157 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) [697bb8b4] Autorecovering 1 storage domains >2012-08-07 13:30:00,158 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) [697bb8b4] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 13:30:00,163 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-43) [3885ef82] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:30:00,223 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-43) [3885ef82] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 13:30:00,269 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-43) [3885ef82] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:30:00,270 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-43) [3885ef82] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:30 PM >2012-08-07 13:30:00,285 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [3885ef82] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 12f32daa >2012-08-07 13:33:00,291 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [3885ef82] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 13:33:00,292 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [3885ef82] FINISH, ConnectStorageServerVDSCommand, log id: 12f32daa >2012-08-07 13:33:00,293 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [3885ef82] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 13:33:00,310 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-43) [3885ef82] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:33 PM >2012-08-07 13:33:00,311 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-43) [3885ef82] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 6728c972 >2012-08-07 13:33:00,608 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-43) [3885ef82] Failed in ActivateStorageDomainVDS method >2012-08-07 13:33:00,608 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-43) [3885ef82] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:33:00,609 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-43) [3885ef82] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:33:00,612 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-43) [3885ef82] FINISH, ActivateStorageDomainVDSCommand, log id: 6728c972 >2012-08-07 13:33:00,613 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-43) [3885ef82] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:33:00,625 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-43) [3885ef82] Command [id=230b9b9d-aff6-454e-954e-6dcadd80195f]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 13:33:00,647 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) [3885ef82] Checking autorecoverable storage domains done >2012-08-07 13:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable hosts >2012-08-07 13:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Autorecovering 0 hosts >2012-08-07 13:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable hosts done >2012-08-07 13:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable storage domains >2012-08-07 13:35:00,072 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Autorecovering 1 storage domains >2012-08-07 13:35:00,073 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 13:35:00,074 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-86) [79f4a585] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:35:00,248 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-86) [79f4a585] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 13:35:00,273 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-86) [79f4a585] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:35:00,274 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-86) [79f4a585] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:35 PM >2012-08-07 13:35:00,299 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [79f4a585] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 74bbae7 >2012-08-07 13:38:00,306 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-46) [79f4a585] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 13:38:00,307 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [79f4a585] FINISH, ConnectStorageServerVDSCommand, log id: 74bbae7 >2012-08-07 13:38:00,308 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-46) [79f4a585] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 13:38:00,325 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-86) [79f4a585] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:38 PM >2012-08-07 13:38:00,326 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-86) [79f4a585] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 689f1e01 >2012-08-07 13:38:00,604 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-86) [79f4a585] Failed in ActivateStorageDomainVDS method >2012-08-07 13:38:00,605 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-86) [79f4a585] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:38:00,606 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-86) [79f4a585] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:38:00,609 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-86) [79f4a585] FINISH, ActivateStorageDomainVDSCommand, log id: 689f1e01 >2012-08-07 13:38:00,609 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-86) [79f4a585] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:38:00,619 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-86) [79f4a585] Command [id=47bae71b-86a3-40ca-9de9-a66e466b02a9]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 13:38:00,637 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) [79f4a585] Checking autorecoverable storage domains done >2012-08-07 13:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [33314445] Checking autorecoverable hosts >2012-08-07 13:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [33314445] Autorecovering 0 hosts >2012-08-07 13:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [33314445] Checking autorecoverable hosts done >2012-08-07 13:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [33314445] Checking autorecoverable storage domains >2012-08-07 13:40:00,022 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [33314445] Autorecovering 1 storage domains >2012-08-07 13:40:00,023 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [33314445] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 13:40:00,024 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [7d71e513] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:40:00,126 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [7d71e513] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 13:40:00,162 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [7d71e513] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:40:00,163 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [7d71e513] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:40 PM >2012-08-07 13:40:00,184 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [7d71e513] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 55fc2b50 >2012-08-07 13:43:00,187 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [7d71e513] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 13:43:00,190 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [7d71e513] FINISH, ConnectStorageServerVDSCommand, log id: 55fc2b50 >2012-08-07 13:43:00,191 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [7d71e513] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 13:43:00,205 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [7d71e513] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:43 PM >2012-08-07 13:43:00,206 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-2) [7d71e513] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 55421d87 >2012-08-07 13:43:00,482 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-2) [7d71e513] Failed in ActivateStorageDomainVDS method >2012-08-07 13:43:00,482 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-2) [7d71e513] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:43:00,483 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [7d71e513] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:43:00,486 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-2) [7d71e513] FINISH, ActivateStorageDomainVDSCommand, log id: 55421d87 >2012-08-07 13:43:00,487 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [7d71e513] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:43:00,499 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-2) [7d71e513] Command [id=7de82b74-47de-43e1-9967-ac3fbb56f665]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 13:43:00,538 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [7d71e513] Checking autorecoverable storage domains done >2012-08-07 13:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable hosts >2012-08-07 13:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Autorecovering 0 hosts >2012-08-07 13:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable hosts done >2012-08-07 13:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable storage domains >2012-08-07 13:45:00,180 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Autorecovering 1 storage domains >2012-08-07 13:45:00,180 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 13:45:00,183 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [47fe85ab] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:45:00,284 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [47fe85ab] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 13:45:00,317 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [47fe85ab] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:45:00,318 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [47fe85ab] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:45 PM >2012-08-07 13:45:00,333 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [47fe85ab] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 5e1f6577 >2012-08-07 13:48:00,337 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [47fe85ab] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 13:48:00,337 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [47fe85ab] FINISH, ConnectStorageServerVDSCommand, log id: 5e1f6577 >2012-08-07 13:48:00,340 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [47fe85ab] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 13:48:00,347 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [47fe85ab] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:48 PM >2012-08-07 13:48:00,347 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-26) [47fe85ab] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 4244ecdd >2012-08-07 13:48:00,602 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-26) [47fe85ab] Failed in ActivateStorageDomainVDS method >2012-08-07 13:48:00,603 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-26) [47fe85ab] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:48:00,604 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) [47fe85ab] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:48:00,606 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-26) [47fe85ab] FINISH, ActivateStorageDomainVDSCommand, log id: 4244ecdd >2012-08-07 13:48:00,607 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [47fe85ab] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:48:00,613 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [47fe85ab] Command [id=77f89749-fc42-4e87-aa29-338d194b7d05]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 13:48:00,639 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [47fe85ab] Checking autorecoverable storage domains done >2012-08-07 13:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [14a40e4e] Checking autorecoverable hosts >2012-08-07 13:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [14a40e4e] Autorecovering 0 hosts >2012-08-07 13:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [14a40e4e] Checking autorecoverable hosts done >2012-08-07 13:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [14a40e4e] Checking autorecoverable storage domains >2012-08-07 13:50:00,074 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [14a40e4e] Autorecovering 1 storage domains >2012-08-07 13:50:00,074 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [14a40e4e] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 13:50:00,076 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [572f8710] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:50:00,174 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [572f8710] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 13:50:00,254 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [572f8710] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:50:00,255 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [572f8710] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:50 PM >2012-08-07 13:50:00,268 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [572f8710] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 4a31c05b >2012-08-07 13:53:00,271 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-46) [572f8710] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 13:53:00,273 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [572f8710] FINISH, ConnectStorageServerVDSCommand, log id: 4a31c05b >2012-08-07 13:53:00,274 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-46) [572f8710] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 13:53:00,296 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [572f8710] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 1:53 PM >2012-08-07 13:53:00,297 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-35) [572f8710] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 72ff65b2 >2012-08-07 13:53:00,548 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-35) [572f8710] Failed in ActivateStorageDomainVDS method >2012-08-07 13:53:00,549 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-35) [572f8710] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:53:00,550 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-35) [572f8710] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:53:00,553 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-35) [572f8710] FINISH, ActivateStorageDomainVDSCommand, log id: 72ff65b2 >2012-08-07 13:53:00,553 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [572f8710] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 13:53:00,565 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-35) [572f8710] Command [id=a16a87b4-1f9d-44a4-8d7e-5bd44ca286f9]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 13:53:00,601 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-35) [572f8710] Checking autorecoverable storage domains done >2012-08-07 13:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts >2012-08-07 13:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering 0 hosts >2012-08-07 13:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts done >2012-08-07 13:55:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable storage domains >2012-08-07 13:55:00,143 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering 1 storage domains >2012-08-07 13:55:00,144 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 13:55:00,147 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [2be8fe0] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:55:00,208 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [2be8fe0] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 13:55:00,241 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [2be8fe0] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 13:55:00,242 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-52) [2be8fe0] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 1:55 PM >2012-08-07 13:55:00,263 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [2be8fe0] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 3dbefab6 >2012-08-07 13:55:53,311 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-50) DbUserCacheManager::refreshAllUserData() - entered >2012-08-07 13:55:54,919 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp--127.0.0.1-8009-18) [655aabd8] Running command: LogoutUserCommand internal: false. >2012-08-07 14:00:57,636 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) Start time: 8/7/12 2:00 PM >2012-08-07 14:00:57,665 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (MSC service thread 1-1) Compiled stored procedure. Call string is [{call get_all_commands()}] >2012-08-07 14:00:57,666 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (MSC service thread 1-1) SqlCall for procedure [get_all_commands] compiled >2012-08-07 14:00:57,771 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (MSC service thread 1-1) Compiled stored procedure. Call string is [{call get_entity_snapshot_by_command_id(?)}] >2012-08-07 14:00:57,772 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (MSC service thread 1-1) SqlCall for procedure [get_entity_snapshot_by_command_id] compiled >2012-08-07 14:00:57,782 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (MSC service thread 1-1) Command [id=2b541745-7532-46ff-b83e-d8fcd2509adc]: Going over compensation data. >2012-08-07 14:00:58,181 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (MSC service thread 1-1) Command [id=2b541745-7532-46ff-b83e-d8fcd2509adc]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 14:00:58,236 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) Running compensation on startup for Command : org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand , Command Id : 2b541745-7532-46ff-b83e-d8fcd2509adc >2012-08-07 14:00:58,252 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (MSC service thread 1-1) Compiled stored procedure. Call string is [{call getallfromvdcoption()}] >2012-08-07 14:00:58,253 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (MSC service thread 1-1) SqlCall for procedure [GetAllFromVdcOption] compiled >2012-08-07 14:00:58,312 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (MSC service thread 1-1) Compiled stored procedure. Call string is [{call getvdcoptionbyname(?, ?)}] >2012-08-07 14:00:58,315 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (MSC service thread 1-1) SqlCall for procedure [GetVdcOptionByName] compiled >2012-08-07 14:00:58,345 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: CbcCheckOnVdsChange >2012-08-07 14:00:58,364 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: CAEngineKey >2012-08-07 14:00:58,365 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: ENGINEEARLib >2012-08-07 14:00:58,393 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: MinimalETLVersion >2012-08-07 14:00:58,436 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: ScriptsPath >2012-08-07 14:00:58,441 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: SQLServerI18NPrefix >2012-08-07 14:00:58,564 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (MSC service thread 1-1) Failed to decrypt Data must start with zero >2012-08-07 14:00:58,564 DEBUG [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (MSC service thread 1-1) Failed to decrypt: javax.crypto.BadPaddingException: Data must start with zero > at sun.security.rsa.RSAPadding.unpadV15(RSAPadding.java:325) [rt.jar:1.7.0_03-icedtea] > at sun.security.rsa.RSAPadding.unpad(RSAPadding.java:272) [rt.jar:1.7.0_03-icedtea] > at com.sun.crypto.provider.RSACipher.doFinal(RSACipher.java:356) > at com.sun.crypto.provider.RSACipher.engineDoFinal(RSACipher.java:382) > at javax.crypto.Cipher.doFinal(Cipher.java:1921) [jce.jar:1.7.0_03-icedtea] > at org.ovirt.engine.core.engineencryptutils.EncryptionUtils.decrypt(EncryptionUtils.java:157) [engine-encryptutils.jar:] > at org.ovirt.engine.core.engineencryptutils.EncryptionUtils.decrypt(EncryptionUtils.java:141) [engine-encryptutils.jar:] > at org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils.GetValue(DBConfigUtils.java:107) [engine-dal.jar:] > at org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils.updateOption(DBConfigUtils.java:278) [engine-dal.jar:] > at org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils.RefreshVdcOptionCache(DBConfigUtils.java:35) [engine-dal.jar:] > at org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils.<init>(DBConfigUtils.java:169) [engine-dal.jar:] > at org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils.<init>(DBConfigUtils.java:155) [engine-dal.jar:] > at org.ovirt.engine.core.bll.Backend.Initialize(Backend.java:170) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.create(Backend.java:118) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:130) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ManagedReferenceFieldInjectionInterceptorFactory$ManagedReferenceFieldInjectionInterceptor.processInvocation(ManagedReferenceFieldInjectionInterceptorFactory.java:112) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ManagedReferenceInterceptorFactory$ManagedReferenceInterceptor.processInvocation(ManagedReferenceInterceptorFactory.java:95) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ManagedReferenceInterceptorFactory$ManagedReferenceInterceptor.processInvocation(ManagedReferenceInterceptorFactory.java:95) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:228) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.requiresNew(CMTTxInterceptor.java:333) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.SingletonLifecycleCMTTxInterceptor.processInvocation(SingletonLifecycleCMTTxInterceptor.java:56) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.BasicComponent.constructComponentInstance(BasicComponent.java:161) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ee.component.BasicComponent.createInstance(BasicComponent.java:85) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponent.getComponentInstance(SingletonComponent.java:116) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponent.start(SingletonComponent.java:130) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ComponentStartService.start(ComponentStartService.java:44) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.msc.service.ServiceControllerImpl$StartTask.startService(ServiceControllerImpl.java:1811) > at org.jboss.msc.service.ServiceControllerImpl$StartTask.run(ServiceControllerImpl.java:1746) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 14:00:58,612 ERROR [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (MSC service thread 1-1) Failed to decrypt value for property TruststorePass will be used encrypted value >2012-08-07 14:00:58,700 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) VDSBrokerFrontend: 8/7/12 2:00 PM >2012-08-07 14:00:58,711 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) CpuFlagsManager: 8/7/12 2:00 PM >2012-08-07 14:00:58,714 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-1) Setting audit clean up manager to run at: 35 35 3 * * ? >2012-08-07 14:00:58,753 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) AuditLogCleanupManager: 8/7/12 2:00 PM >2012-08-07 14:00:58,762 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-1) TagsDirector initialization >2012-08-07 14:00:58,793 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-1) Tag root added to tree >2012-08-07 14:00:58,810 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (MSC service thread 1-1) Compiled stored procedure. Call string is [{call gettagsbyparent_id(?)}] >2012-08-07 14:00:58,811 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (MSC service thread 1-1) SqlCall for procedure [GettagsByparent_id] compiled >2012-08-07 14:00:58,815 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) TagsDirector: 8/7/12 2:00 PM >2012-08-07 14:00:58,822 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) IsoDomainListSyncronizer: 8/7/12 2:00 PM >2012-08-07 14:00:58,853 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) InitHandlers: 8/7/12 2:00 PM >2012-08-07 14:00:58,869 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-1) Code VDS_FENCING_OPERATION_FAILED appears more then once in string table. >2012-08-07 14:00:58,871 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) ErrorTranslator: 8/7/12 2:00 PM >2012-08-07 14:00:58,877 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) VdsErrorTranslator: 8/7/12 2:00 PM >2012-08-07 14:00:58,878 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) Mark uncompleted jobs as UNKNOWN: 8/7/12 2:00 PM >2012-08-07 14:00:58,927 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) JobRepositoryCleanupManager: 8/7/12 2:00 PM >2012-08-07 14:00:58,929 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) AutoRecoveryManager: 8/7/12 2:00 PM >2012-08-07 14:00:58,936 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) ExecutionMessageDirector: 8/7/12 2:00 PM >2012-08-07 14:00:58,966 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (MSC service thread 1-1) UsersDomainsCacheManager: 8/7/12 2:00 PM >2012-08-07 14:00:58,966 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-2) InitResourceManager: 8/7/12 2:00 PM >2012-08-07 14:00:58,977 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-2) ResourceManager::ResourceManager::Entered >2012-08-07 14:00:59,007 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (MSC service thread 1-2) Compiled stored procedure. Call string is [{call getallfromvds(?, ?)}] >2012-08-07 14:00:59,010 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (MSC service thread 1-2) SqlCall for procedure [GetAllFromVds] compiled >2012-08-07 14:00:59,045 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (MSC service thread 1-1) DbUserCacheManager: 8/7/12 2:00 PM >2012-08-07 14:00:59,091 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-1) Compiled stored procedure. Call string is [{call getallfromad_groups()}] >2012-08-07 14:00:59,092 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-1) SqlCall for procedure [GetAllFromad_groups] compiled >2012-08-07 14:00:59,102 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-1) DbUserCacheManager::refreshAllUserData() - entered >2012-08-07 14:00:59,116 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-1) Compiled stored procedure. Call string is [{call getallfromusers()}] >2012-08-07 14:00:59,116 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-1) SqlCall for procedure [GetAllFromUsers] compiled >2012-08-07 14:00:59,211 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (MSC service thread 1-2) Compiled stored procedure. Call string is [{call getallfromvms(?, ?)}] >2012-08-07 14:00:59,212 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (MSC service thread 1-2) SqlCall for procedure [GetAllFromVms] compiled >2012-08-07 14:00:59,317 DEBUG [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-2) Putting thread to sleep for 5,000 milliseconds before adding VDS 4196a566-dee6-11e1-b66e-c35c5273fee7, with name purple-vds2 >2012-08-07 14:01:04,344 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (MSC service thread 1-2) Compiled stored procedure. Call string is [{call getvdsgroupbyvdsgroupid(?, ?, ?)}] >2012-08-07 14:01:04,347 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (MSC service thread 1-2) SqlCall for procedure [GetVdsGroupByVdsGroupId] compiled >2012-08-07 14:01:04,356 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-2) Eneterd VdsManager:constructor >2012-08-07 14:01:04,357 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-2) vdsBroker(purple-vds2,54,321) >2012-08-07 14:01:04,371 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Initializing key store >2012-08-07 14:01:04,372 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Certificate chain 'engine': >2012-08-07 14:01:04,373 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Certificate 1: >2012-08-07 14:01:04,377 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Subject DN: CN=leonid-rhevm31.qa.lab.tlv.redhat.com, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:04,377 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:04,393 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:04,394 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Valid until: Mon Jul 10 13:07:20 IDT 2017 >2012-08-07 14:01:04,399 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:04,400 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Certificate 2: >2012-08-07 14:01:04,401 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:04,402 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:04,402 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:04,403 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:04,407 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:04,408 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Initializing key manager >2012-08-07 14:01:04,414 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Initializing key store >2012-08-07 14:01:04,414 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Trusted certificate 'cacert': >2012-08-07 14:01:04,417 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:04,418 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:04,418 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:04,419 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:04,423 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:04,424 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Trusted certificate 'engine': >2012-08-07 14:01:04,425 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Subject DN: CN=leonid-rhevm31.qa.lab.tlv.redhat.com, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:04,425 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:04,426 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:04,430 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Valid until: Mon Jul 10 13:07:20 IDT 2017 >2012-08-07 14:01:04,430 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:04,431 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory] (MSC service thread 1-2) Initializing trust manager >2012-08-07 14:01:04,605 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-2) ResourceManager::AddVds - VDS 4196a566-dee6-11e1-b66e-c35c5273fee7 was added to the Resource Manager >2012-08-07 14:01:04,606 DEBUG [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-2) Putting thread to sleep for 5,000 milliseconds before adding VDS 47028088-dee6-11e1-bffa-2f8f15de3134, with name purple-vds3 >2012-08-07 14:01:06,594 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-2) Compiled stored procedure. Call string is [{call getvdsbyvdsid(?, ?, ?)}] >2012-08-07 14:01:06,595 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-2) SqlCall for procedure [GetVdsByVdsId] compiled >2012-08-07 14:01:06,677 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-2) Compiled stored procedure. Call string is [{call getvmsrunningonvds(?)}] >2012-08-07 14:01:06,677 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-2) SqlCall for procedure [GetVmsRunningOnVds] compiled >2012-08-07 14:01:06,730 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-2) vdsManager::refreshVdsStats entered, vds = 4196a566-dee6-11e1-b66e-c35c5273fee7 : purple-vds2 >2012-08-07 14:01:06,753 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-2) START, GetStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@b6ba0a17), log id: 1012d622 >2012-08-07 14:01:06,958 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-1) Server certificate 1: >2012-08-07 14:01:06,959 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-1) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:06,960 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-1) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:06,963 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-1) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:06,964 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-1) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:06,964 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-1) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:06,965 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-1) Server certificate 2: >2012-08-07 14:01:06,968 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-1) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:06,969 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-1) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:06,969 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-1) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:06,970 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-1) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:06,981 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-1) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:07,154 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-2) Compiled stored procedure. Call string is [{call getinterface_viewbyvds_id(?, ?, ?)}] >2012-08-07 14:01:07,155 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-2) SqlCall for procedure [Getinterface_viewByvds_id] compiled >2012-08-07 14:01:07,214 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-2) FINISH, GetStatsVDSCommand, log id: 1012d622 >2012-08-07 14:01:07,250 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-2) Compiled stored procedure. Call string is [{call getallnetworkbyclusterid(?, ?, ?)}] >2012-08-07 14:01:07,252 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-2) SqlCall for procedure [GetAllNetworkByClusterId] compiled >2012-08-07 14:01:07,295 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-2) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@62d484d8 >2012-08-07 14:01:07,296 DEBUG [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-2) refreshCapabilities:GetCapabilitiesVDSCommand started method >2012-08-07 14:01:07,315 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (QuartzScheduler_Worker-2) START, GetCapabilitiesVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@76e8c739), log id: 4e2cf9bb >2012-08-07 14:01:07,344 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-2) Server certificate 1: >2012-08-07 14:01:07,346 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-2) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:07,347 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-2) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:07,347 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-2) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:07,348 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-2) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:07,348 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-2) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:07,349 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-2) Server certificate 2: >2012-08-07 14:01:07,353 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-2) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:07,354 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-2) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:07,355 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-2) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:07,355 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-2) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:07,356 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-2) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:07,596 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (QuartzScheduler_Worker-2) FINISH, GetCapabilitiesVDSCommand, log id: 4e2cf9bb >2012-08-07 14:01:07,862 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: UNASSIGNED not exist in string table >2012-08-07 14:01:07,867 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table >2012-08-07 14:01:07,868 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: DWH_STOPPED not exist in string table >2012-08-07 14:01:07,870 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: DWH_STARTED not exist in string table >2012-08-07 14:01:07,871 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: DWH_ERROR not exist in string table >2012-08-07 14:01:07,885 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2012-08-07 14:01:07,886 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_FAILED_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2012-08-07 14:01:07,886 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2012-08-07 14:01:07,887 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_FAILED_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2012-08-07 14:01:07,995 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-2) vds::refreshVmList entered >2012-08-07 14:01:07,996 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-2) START, GetAllVmStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@cb05e2d3), log id: 76edbd06 >2012-08-07 14:01:08,002 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-3) Server certificate 1: >2012-08-07 14:01:08,002 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-3) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:08,002 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-3) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:08,003 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-3) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:08,003 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-3) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:08,004 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-3) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:08,005 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-3) Server certificate 2: >2012-08-07 14:01:08,006 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-3) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:08,008 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-3) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:08,008 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-3) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:08,009 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-3) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:08,009 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-3) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:08,078 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-2) Compiled stored procedure. Call string is [{call getdisksvmguid(?, ?, ?)}] >2012-08-07 14:01:08,079 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-2) SqlCall for procedure [GetDisksVmGuid] compiled >2012-08-07 14:01:08,269 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-2) FINISH, GetAllVmStatsVDSCommand, return: {6c1fcddf-86d6-4533-905b-abb11b775f5b=org.ovirt.engine.core.compat.KeyValuePairCompat@b1a3e513, 2842672f-6230-434f-8232-e88e71560092=org.ovirt.engine.core.compat.KeyValuePairCompat@51d2f250, e5a192f1-3f9d-48e1-a817-28f72815c646=org.ovirt.engine.core.compat.KeyValuePairCompat@4e00e2de, 8738bb81-c73e-4a41-a24a-c4c49491c536=org.ovirt.engine.core.compat.KeyValuePairCompat@44c0538b, 6a729fb0-47fe-4eba-9ba3-2b939eee2b19=org.ovirt.engine.core.compat.KeyValuePairCompat@650efa52, ba81adbe-b311-4aef-b6c1-5f84f0f3c94d=org.ovirt.engine.core.compat.KeyValuePairCompat@fe802c89, 54b872c6-cefc-4a19-b48e-9bc1a09285f9=org.ovirt.engine.core.compat.KeyValuePairCompat@f7e883ab, 9dbe6b1e-2a98-449e-8bd7-2d025c420a42=org.ovirt.engine.core.compat.KeyValuePairCompat@34df9a21}, log id: 76edbd06 >2012-08-07 14:01:08,309 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-2) Compiled stored procedure. Call string is [{call getvm_interfacebyvm_id(?, ?, ?)}] >2012-08-07 14:01:08,310 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-2) SqlCall for procedure [Getvm_interfaceByvm_id] compiled >2012-08-07 14:01:09,611 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-2) Eneterd VdsManager:constructor >2012-08-07 14:01:09,614 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-2) vdsBroker(purple-vds3,54,321) >2012-08-07 14:01:09,627 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-2) ResourceManager::AddVds - VDS 47028088-dee6-11e1-bffa-2f8f15de3134 was added to the Resource Manager >2012-08-07 14:01:09,675 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (MSC service thread 1-2) Compiled stored procedure. Call string is [{call getallfromstorage_pool(?, ?)}] >2012-08-07 14:01:09,676 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (MSC service thread 1-2) SqlCall for procedure [GetAllFromstorage_pool] compiled >2012-08-07 14:01:09,719 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (MSC service thread 1-2) AsyncTaskManager: Initialization of AsyncTaskManager completed successfully. >2012-08-07 14:01:09,720 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-2) AsyncTaskManager: 8/7/12 2:01 PM >2012-08-07 14:01:09,725 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-2) VdsLoadBalancer: 8/7/12 2:01 PM >2012-08-07 14:01:09,744 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (pool-3-thread-4) MacPoolManager started: 8/7/12 2:01 PM >2012-08-07 14:01:10,045 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (pool-3-thread-4) MacPoolManager finished: 8/7/12 2:01 PM >2012-08-07 14:01:10,355 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-2) Initializing Host: purple-vds2 >2012-08-07 14:01:10,399 DEBUG [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-2) [40cf8fd] Permission check skipped for internal action HandleVdsVersion. >2012-08-07 14:01:10,412 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-2) Compiled stored procedure. Call string is [{call getaction_version_mapbyaction_type(?)}] >2012-08-07 14:01:10,413 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-2) SqlCall for procedure [Getaction_version_mapByaction_type] compiled >2012-08-07 14:01:10,589 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-2) [40cf8fd] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-07 14:01:10,611 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-2) Compiled stored procedure. Call string is [{call getvdsdynamicbyvdsid(?)}] >2012-08-07 14:01:10,612 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-2) SqlCall for procedure [GetVdsDynamicByVdsId] compiled >2012-08-07 14:01:10,632 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-2) Compiled stored procedure. Call string is [{call getstorage_poolbyid(?, ?, ?)}] >2012-08-07 14:01:10,633 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-2) SqlCall for procedure [Getstorage_poolByid] compiled >2012-08-07 14:01:10,656 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-2) Compiled stored procedure. Call string is [{call getstoragedomainidsbystoragepoolidandstatus(?, ?)}] >2012-08-07 14:01:10,657 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-2) SqlCall for procedure [GetStorageDomainIdsByStoragePoolIdAndStatus] compiled >2012-08-07 14:01:11,631 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-3) vdsManager::refreshVdsStats entered, vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3 >2012-08-07 14:01:11,633 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-3) START, GetStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@317798a9), log id: 1178a9a6 >2012-08-07 14:01:11,646 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-5) Server certificate 1: >2012-08-07 14:01:11,646 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-5) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:11,647 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-5) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:11,647 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-5) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:11,648 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-5) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:11,653 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-5) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:11,653 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-5) Server certificate 2: >2012-08-07 14:01:11,654 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-5) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:11,654 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-5) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:11,655 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-5) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:11,656 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-5) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:11,656 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-5) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:11,696 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-3) FINISH, GetStatsVDSCommand, log id: 1178a9a6 >2012-08-07 14:01:11,700 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-3) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@504967ab >2012-08-07 14:01:11,701 DEBUG [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-3) refreshCapabilities:GetCapabilitiesVDSCommand started method >2012-08-07 14:01:11,709 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (QuartzScheduler_Worker-3) START, GetCapabilitiesVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@4d10ed2c), log id: 4ba0d875 >2012-08-07 14:01:11,724 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-6) Server certificate 1: >2012-08-07 14:01:11,724 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-6) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:11,725 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-6) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:11,725 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-6) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:11,726 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-6) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:11,730 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-6) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:11,731 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-6) Server certificate 2: >2012-08-07 14:01:11,731 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-6) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:11,732 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-6) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:11,736 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-6) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:11,737 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-6) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:11,738 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-6) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:11,987 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (QuartzScheduler_Worker-3) FINISH, GetCapabilitiesVDSCommand, log id: 4ba0d875 >2012-08-07 14:01:12,160 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-3) vds::refreshVmList entered >2012-08-07 14:01:12,161 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-3) START, GetAllVmStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@9d03e3d4), log id: 616036c6 >2012-08-07 14:01:12,172 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-7) Server certificate 1: >2012-08-07 14:01:12,173 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-7) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:12,173 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-7) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:12,174 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-7) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:12,174 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-7) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:12,175 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-7) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:12,175 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-7) Server certificate 2: >2012-08-07 14:01:12,175 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-7) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:12,180 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-7) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:12,180 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-7) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:12,181 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-7) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:12,181 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-7) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:12,210 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-3) FINISH, GetAllVmStatsVDSCommand, return: {}, log id: 616036c6 >2012-08-07 14:01:12,288 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-3) Initializing Host: purple-vds3 >2012-08-07 14:01:12,292 DEBUG [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-3) [5a6227d1] Permission check skipped for internal action HandleVdsVersion. >2012-08-07 14:01:12,299 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-3) [5a6227d1] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-07 14:01:12,676 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-4) vds::refreshVmList entered >2012-08-07 14:01:12,697 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-8) Server certificate 1: >2012-08-07 14:01:12,698 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-8) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:12,698 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-8) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:12,699 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-8) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:12,700 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-8) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:12,700 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-8) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:12,701 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-8) Server certificate 2: >2012-08-07 14:01:12,701 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-8) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:12,705 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-8) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:12,705 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-8) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:12,709 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-8) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:12,709 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-8) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:14,334 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-5) vds::refreshVmList entered >2012-08-07 14:01:14,342 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-9) Server certificate 1: >2012-08-07 14:01:14,343 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-9) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:14,343 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-9) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:14,344 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-9) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:14,344 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-9) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:14,345 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-9) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:14,349 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-9) Server certificate 2: >2012-08-07 14:01:14,349 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-9) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:14,350 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-9) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:14,350 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-9) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:14,351 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-9) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:14,351 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-9) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:14,762 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-6) vds::refreshVmList entered >2012-08-07 14:01:14,778 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-10) Server certificate 1: >2012-08-07 14:01:14,778 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-10) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:14,779 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-10) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:14,779 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-10) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:14,780 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-10) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:14,780 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-10) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:14,781 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-10) Server certificate 2: >2012-08-07 14:01:14,786 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-10) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:14,787 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-10) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:14,787 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-10) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:14,788 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-10) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:14,792 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-10) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:16,049 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) Initializing servlet! >2012-08-07 14:01:16,390 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-7) vds::refreshVmList entered >2012-08-07 14:01:16,402 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-11) Server certificate 1: >2012-08-07 14:01:16,403 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-11) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:16,403 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-11) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:16,407 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-11) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:16,410 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-11) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:16,411 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-11) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:16,414 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-11) Server certificate 2: >2012-08-07 14:01:16,414 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-11) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:16,415 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-11) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:16,416 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-11) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:16,420 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-11) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:16,421 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-11) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:16,848 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-8) vds::refreshVmList entered >2012-08-07 14:01:16,859 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-12) Server certificate 1: >2012-08-07 14:01:16,860 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-12) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:16,860 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-12) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:16,861 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-12) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:16,866 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-12) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:16,866 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-12) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:16,867 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-12) Server certificate 2: >2012-08-07 14:01:16,867 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-12) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:16,868 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-12) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:16,868 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-12) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:16,869 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-12) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:16,875 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-12) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:17,807 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) Server: RunQuery invoked! >2012-08-07 14:01:17,807 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) Server: RunQuery invoked! >2012-08-07 14:01:17,815 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:17,816 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) IP [10.35.1.174], Session ID [YgWr+C1EurHD9PI7xIhqg36g.undefined] >2012-08-07 14:01:18,480 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-9) vds::refreshVmList entered >2012-08-07 14:01:18,497 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-13) Server certificate 1: >2012-08-07 14:01:18,497 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-13) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:18,497 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-13) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:18,498 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-13) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:18,498 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-13) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:18,499 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-13) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:18,499 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-13) Server certificate 2: >2012-08-07 14:01:18,500 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-13) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:18,500 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-13) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:18,501 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-13) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:18,501 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-13) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:18,502 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-13) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:18,937 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-10) vds::refreshVmList entered >2012-08-07 14:01:18,950 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-14) Server certificate 1: >2012-08-07 14:01:18,951 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-14) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:18,951 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-14) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:18,952 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-14) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:18,954 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-14) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:18,955 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-14) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:18,955 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-14) Server certificate 2: >2012-08-07 14:01:18,956 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-14) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:18,961 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-14) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:18,961 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-14) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:18,962 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-14) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:18,962 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-14) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:19,804 DEBUG [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-15) [3644334] Permission check skipped for internal action SetStoragePoolStatus. >2012-08-07 14:01:19,814 DEBUG [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-16) [52278849] Permission check skipped for internal action SetStoragePoolStatus. >2012-08-07 14:01:19,859 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-15) [3644334] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-07 14:01:19,862 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-16) [52278849] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 7a858a05-d5d9-40de-9a4e-c24b1980eb23 Type: StoragePool >2012-08-07 14:01:19,895 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-15) Compiled stored procedure. Call string is [{call getstorage_pool_iso_mapsbybystorage_pool_id(?, ?)}] >2012-08-07 14:01:19,895 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-15) SqlCall for procedure [Getstorage_pool_iso_mapsByBystorage_pool_id] compiled >2012-08-07 14:01:20,139 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-15) [3644334] START, GetStoragePoolInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 4d856689 >2012-08-07 14:01:20,158 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-15) Compiled stored procedure. Call string is [{call getupandprioritizedvds(?)}] >2012-08-07 14:01:20,159 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-15) SqlCall for procedure [GetUpAndPrioritizedVds] compiled >2012-08-07 14:01:20,182 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-15) [3644334] START, SpmStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f), log id: 728a5ac2 >2012-08-07 14:01:20,197 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-15) Server certificate 1: >2012-08-07 14:01:20,198 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-15) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:20,199 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-15) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:20,199 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-15) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:20,200 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-15) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:20,200 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-15) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:20,201 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-15) Server certificate 2: >2012-08-07 14:01:20,201 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-15) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:20,202 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-15) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:20,207 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-15) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:20,208 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-15) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:20,208 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-15) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:20,217 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-16) [52278849] START, GetStoragePoolInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 3a41a52b >2012-08-07 14:01:20,254 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-16) [52278849] START, SpmStatusVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23), log id: 6f984f7e >2012-08-07 14:01:20,269 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-15) [3644334] FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3de86382, log id: 728a5ac2 >2012-08-07 14:01:20,270 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-15) [3644334] hostFromVds::selectedVds - purple-vds2, spmStatus SPM, storage pool nfs31 >2012-08-07 14:01:20,270 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-16) Server certificate 1: >2012-08-07 14:01:20,275 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-16) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:20,284 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-16) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:20,285 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-16) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:20,295 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-16) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:20,296 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-16) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:20,297 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-16) Server certificate 2: >2012-08-07 14:01:20,297 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-16) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:20,301 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-16) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:20,301 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-16) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:20,302 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-16) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:20,306 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-16) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:20,347 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-15) [3644334] Initialize Irs proxy from vds: purple-vds2 >2012-08-07 14:01:20,355 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-16) [52278849] FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@22c86e7e, log id: 6f984f7e >2012-08-07 14:01:20,356 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [52278849] hostFromVds::selectedVds - purple-vds3, spmStatus SPM, storage pool scsi >2012-08-07 14:01:20,399 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [52278849] Initialize Irs proxy from vds: purple-vds3 >2012-08-07 14:01:20,460 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-19) Compiled stored procedure. Call string is [{call getstorage_domains_by_storagepoolid(?, ?, ?)}] >2012-08-07 14:01:20,461 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-19) SqlCall for procedure [Getstorage_domains_By_storagePoolId] compiled >2012-08-07 14:01:20,462 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-18) Compiled stored procedure. Call string is [{call getstorage_domains_by_storagepoolid(?, ?, ?)}] >2012-08-07 14:01:20,465 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-18) SqlCall for procedure [Getstorage_domains_By_storagePoolId] compiled >2012-08-07 14:01:20,506 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-18) Server certificate 1: >2012-08-07 14:01:20,512 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-18) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:20,512 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-18) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:20,513 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-18) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:20,508 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-17) Server certificate 1: >2012-08-07 14:01:20,519 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-17) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:20,519 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-17) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:20,520 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-17) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:20,521 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-17) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:20,521 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-17) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:20,522 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-17) Server certificate 2: >2012-08-07 14:01:20,524 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-17) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:20,525 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-17) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:20,525 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-17) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:20,526 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-17) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:20,520 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-18) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:20,535 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-18) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:20,535 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-18) Server certificate 2: >2012-08-07 14:01:20,536 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-18) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:20,542 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-18) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:20,542 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-18) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:20,543 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-18) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:20,551 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-18) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:20,550 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-20) vds::refreshVmList entered >2012-08-07 14:01:20,543 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-17) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:20,571 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-19) Server certificate 1: >2012-08-07 14:01:20,599 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-19) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:20,600 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-19) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:20,600 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-19) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:20,601 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-19) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:20,601 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-19) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:20,606 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-19) Server certificate 2: >2012-08-07 14:01:20,607 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-19) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:20,607 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-19) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:20,608 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-19) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:20,623 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-19) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:20,624 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-19) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:20,674 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-15) [3644334] FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@2e0e93d0, log id: 4d856689 >2012-08-07 14:01:20,690 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-15) Compiled stored procedure. Call string is [{call getstorage_domains_by_id_and_by_storage_pool_id(?, ?)}] >2012-08-07 14:01:20,691 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (QuartzScheduler_Worker-15) SqlCall for procedure [Getstorage_domains_By_id_and_by_storage_pool_id] compiled >2012-08-07 14:01:20,846 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) Server: RunQuery invoked! >2012-08-07 14:01:20,846 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:20,848 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-4) Server: RunQuery invoked! >2012-08-07 14:01:20,849 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-4) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:20,875 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-19) START, SPMGetAllTasksInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 77e4898 >2012-08-07 14:01:20,897 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) START, SPMGetAllTasksInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 5a611abf >2012-08-07 14:01:20,929 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-19) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool efe20197-e0a7-49b8-beb4-19b1ed3f8c3f >2012-08-07 14:01:20,933 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-19) START, HSMGetAllTasksInfoVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7), log id: 66c39b2e >2012-08-07 14:01:20,943 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-20) Server certificate 1: >2012-08-07 14:01:20,944 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-20) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:20,944 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-20) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:20,945 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-20) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:20,945 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-20) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:20,946 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-20) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:20,948 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-20) Server certificate 2: >2012-08-07 14:01:20,949 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-20) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:20,949 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-20) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:20,950 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-20) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:20,950 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-20) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:20,951 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-20) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:20,985 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-19) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 66c39b2e >2012-08-07 14:01:20,986 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-19) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 77e4898 >2012-08-07 14:01:20,986 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-19) Discovered no tasks on Storage Pool nfs31 >2012-08-07 14:01:21,012 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-21) vdsManager::refreshVdsStats entered, vds = 4196a566-dee6-11e1-b66e-c35c5273fee7 : purple-vds2 >2012-08-07 14:01:21,013 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-21) START, GetStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@514fb62e), log id: 3f768164 >2012-08-07 14:01:21,029 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-21) Server certificate 1: >2012-08-07 14:01:21,029 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-21) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:21,030 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-21) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:21,030 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-21) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:21,031 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-21) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:21,031 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-21) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:21,032 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-21) Server certificate 2: >2012-08-07 14:01:21,032 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-21) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:21,033 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-21) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:21,038 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-21) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:21,039 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-21) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:21,040 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-21) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:21,072 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-21) FINISH, GetStatsVDSCommand, log id: 3f768164 >2012-08-07 14:01:21,076 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-21) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@72cd6a83 >2012-08-07 14:01:21,077 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-21) vds::refreshVmList entered >2012-08-07 14:01:21,077 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-21) START, GetAllVmStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@895fbcbc), log id: c0bf957 >2012-08-07 14:01:21,089 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-22) Server certificate 1: >2012-08-07 14:01:21,090 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-22) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:21,090 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-22) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:21,091 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-22) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:21,095 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-22) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:21,095 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-22) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:21,096 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-22) Server certificate 2: >2012-08-07 14:01:21,096 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-22) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:21,097 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-22) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:21,097 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-22) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:21,098 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-22) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:21,101 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-22) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:21,204 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-21) FINISH, GetAllVmStatsVDSCommand, return: {6c1fcddf-86d6-4533-905b-abb11b775f5b=org.ovirt.engine.core.compat.KeyValuePairCompat@4feb4b13, 2842672f-6230-434f-8232-e88e71560092=org.ovirt.engine.core.compat.KeyValuePairCompat@f01a5850, e5a192f1-3f9d-48e1-a817-28f72815c646=org.ovirt.engine.core.compat.KeyValuePairCompat@824dc6de, 8738bb81-c73e-4a41-a24a-c4c49491c536=org.ovirt.engine.core.compat.KeyValuePairCompat@e307b98b, 6a729fb0-47fe-4eba-9ba3-2b939eee2b19=org.ovirt.engine.core.compat.KeyValuePairCompat@3566052, ba81adbe-b311-4aef-b6c1-5f84f0f3c94d=org.ovirt.engine.core.compat.KeyValuePairCompat@17df8c, 54b872c6-cefc-4a19-b48e-9bc1a09285f9=org.ovirt.engine.core.compat.KeyValuePairCompat@962fe9ab, 9dbe6b1e-2a98-449e-8bd7-2d025c420a42=org.ovirt.engine.core.compat.KeyValuePairCompat@36774d24}, log id: c0bf957 >2012-08-07 14:01:21,346 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-16) [52278849] FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@5d2d4c1, log id: 3a41a52b >2012-08-07 14:01:21,477 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool 7a858a05-d5d9-40de-9a4e-c24b1980eb23 >2012-08-07 14:01:21,480 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) START, HSMGetAllTasksInfoVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134), log id: 3f924056 >2012-08-07 14:01:21,501 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-23) Server certificate 1: >2012-08-07 14:01:21,502 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-23) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:21,502 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-23) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:21,503 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-23) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:21,505 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-23) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:21,506 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-23) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:21,506 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-23) Server certificate 2: >2012-08-07 14:01:21,507 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-23) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:21,511 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-23) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:21,512 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-23) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:21,512 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-23) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:21,513 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-23) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:21,562 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 3f924056 >2012-08-07 14:01:21,562 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 5a611abf >2012-08-07 14:01:21,563 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-18) Discovered no tasks on Storage Pool scsi >2012-08-07 14:01:22,730 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-22) vdsManager::refreshVdsStats entered, vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3 >2012-08-07 14:01:22,731 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-22) START, GetStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@ec6317), log id: 432ba51d >2012-08-07 14:01:22,750 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-24) Server certificate 1: >2012-08-07 14:01:22,751 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-24) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:22,751 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-24) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:22,752 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-24) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:22,752 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-24) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:22,752 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-24) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:22,753 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-24) Server certificate 2: >2012-08-07 14:01:22,754 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-24) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:22,754 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-24) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:22,755 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-24) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:22,755 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-24) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:22,755 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-24) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:22,798 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-22) FINISH, GetStatsVDSCommand, log id: 432ba51d >2012-08-07 14:01:22,801 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-22) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@3de47a2f >2012-08-07 14:01:22,804 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-22) vds::refreshVmList entered >2012-08-07 14:01:22,808 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-22) START, GetAllVmStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@ced00e25), log id: 6311c367 >2012-08-07 14:01:22,818 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-25) Server certificate 1: >2012-08-07 14:01:22,818 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-25) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:22,819 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-25) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:22,819 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-25) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:22,820 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-25) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:22,823 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-25) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:22,824 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-25) Server certificate 2: >2012-08-07 14:01:22,824 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-25) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:22,825 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-25) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:22,825 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-25) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:22,826 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-25) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:22,829 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-25) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:22,850 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-22) FINISH, GetAllVmStatsVDSCommand, return: {}, log id: 6311c367 >2012-08-07 14:01:23,510 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-23) vds::refreshVmList entered >2012-08-07 14:01:23,527 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-26) Server certificate 1: >2012-08-07 14:01:23,527 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-26) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:23,528 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-26) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:23,528 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-26) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:23,529 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-26) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:23,529 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-26) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:23,530 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-26) Server certificate 2: >2012-08-07 14:01:23,534 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-26) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:23,535 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-26) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:23,535 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-26) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:23,536 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-26) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:23,536 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-26) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:24,944 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-24) vds::refreshVmList entered >2012-08-07 14:01:24,954 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-27) Server certificate 1: >2012-08-07 14:01:24,955 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-27) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:24,955 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-27) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:24,956 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-27) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:24,959 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-27) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:24,960 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-27) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:24,961 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-27) Server certificate 2: >2012-08-07 14:01:24,961 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-27) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:24,962 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-27) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:24,962 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-27) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:24,962 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-27) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:24,966 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-27) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:25,586 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-25) vds::refreshVmList entered >2012-08-07 14:01:25,598 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-28) Server certificate 1: >2012-08-07 14:01:25,598 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-28) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:25,599 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-28) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:25,599 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-28) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:25,602 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-28) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:25,602 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-28) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:25,603 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-28) Server certificate 2: >2012-08-07 14:01:25,603 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-28) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:25,606 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-28) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:25,607 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-28) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:25,607 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-28) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:25,607 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-28) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:25,829 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) Server: RunQuery invoked! >2012-08-07 14:01:25,829 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:25,833 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) Server: RunQuery invoked! >2012-08-07 14:01:25,834 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:27,008 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-26) vds::refreshVmList entered >2012-08-07 14:01:27,020 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-29) Server certificate 1: >2012-08-07 14:01:27,021 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-29) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:27,021 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-29) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:27,022 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-29) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:27,022 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-29) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:27,023 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-29) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:27,027 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-29) Server certificate 2: >2012-08-07 14:01:27,028 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-29) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:27,029 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-29) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:27,033 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-29) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:27,034 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-29) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:27,034 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-29) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:27,655 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-27) vds::refreshVmList entered >2012-08-07 14:01:27,669 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-30) Server certificate 1: >2012-08-07 14:01:27,669 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-30) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:27,669 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-30) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:27,670 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-30) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:27,670 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-30) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:27,671 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-30) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:27,671 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-30) Server certificate 2: >2012-08-07 14:01:27,672 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-30) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:27,677 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-30) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:27,677 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-30) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:27,678 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-30) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:27,678 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-30) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:29,090 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-28) vds::refreshVmList entered >2012-08-07 14:01:29,098 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-31) Server certificate 1: >2012-08-07 14:01:29,098 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-31) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:29,099 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-31) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:29,099 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-31) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:29,100 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-31) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:29,100 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-31) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:29,101 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-31) Server certificate 2: >2012-08-07 14:01:29,101 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-31) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:29,102 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-31) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:29,104 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-31) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:29,105 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-31) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:29,105 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-31) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:29,717 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-29) vds::refreshVmList entered >2012-08-07 14:01:29,725 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-32) Server certificate 1: >2012-08-07 14:01:29,725 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-32) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:29,726 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-32) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:29,726 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-32) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:29,727 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-32) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:29,733 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-32) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:29,734 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-32) Server certificate 2: >2012-08-07 14:01:29,734 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-32) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:29,735 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-32) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:29,735 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-32) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:29,736 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-32) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:29,736 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-32) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:30,780 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:30,784 DEBUG [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-7) IsUserAutorizedToRunAction: Login - no permission check >2012-08-07 14:01:30,802 DEBUG [org.ovirt.engine.core.bll.adbroker.LdapBrokerBase] (ajp--127.0.0.1-8009-7) RunAdAction Entry, actionType=AuthenticateUser >2012-08-07 14:01:30,814 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (ajp--127.0.0.1-8009-7) Compiled stored procedure. Call string is [{call getuserbyusername(?)}] >2012-08-07 14:01:30,814 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (ajp--127.0.0.1-8009-7) SqlCall for procedure [GetUserByUserName] compiled >2012-08-07 14:01:30,830 DEBUG [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-7) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running LoginAdminUser, on Bottom with id bbb00000-0000-0000-0000-123456789bbb >2012-08-07 14:01:30,842 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) Server: RunQuery invoked! >2012-08-07 14:01:30,843 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:30,850 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) Server: RunQuery invoked! >2012-08-07 14:01:30,850 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:30,854 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (ajp--127.0.0.1-8009-7) Compiled stored procedure. Call string is [{call getallrolesbyuseridandgroupids(?, ?)}] >2012-08-07 14:01:30,855 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (ajp--127.0.0.1-8009-7) SqlCall for procedure [GetAllRolesByUserIdAndGroupIds] compiled >2012-08-07 14:01:30,885 DEBUG [org.ovirt.engine.core.bll.MultiLevelAdministrationHandler] (ajp--127.0.0.1-8009-7) LoginAdminUser: User logged to admin using role SuperUser >2012-08-07 14:01:30,886 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-7) Checking if user admin@internal is an admin, result true >2012-08-07 14:01:30,890 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-7) Running command: LoginAdminUserCommand internal: false. >2012-08-07 14:01:30,904 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (ajp--127.0.0.1-8009-7) Compiled stored procedure. Call string is [{call getuserbyuserid(?)}] >2012-08-07 14:01:30,905 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (ajp--127.0.0.1-8009-7) SqlCall for procedure [GetUserByUserId] compiled >2012-08-07 14:01:30,932 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-35) START, SpmStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f), log id: 4a8ff3f9 >2012-08-07 14:01:30,961 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-34) Server certificate 1: >2012-08-07 14:01:30,962 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-34) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:30,962 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-34) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:30,963 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-34) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:30,963 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-34) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:30,964 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-34) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:30,964 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-34) Server certificate 2: >2012-08-07 14:01:30,965 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-34) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:30,969 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-34) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:30,970 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-34) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:30,970 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-34) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:30,971 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-34) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:31,010 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) Server: RunQuery invoked! >2012-08-07 14:01:31,011 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,043 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-35) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@9d0d49e, log id: 4a8ff3f9 >2012-08-07 14:01:31,046 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-35) START, GetStoragePoolInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 7381ab33 >2012-08-07 14:01:31,062 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) Server: RunQuery invoked! >2012-08-07 14:01:31,069 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,068 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) Server: RunQuery invoked! >2012-08-07 14:01:31,064 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) Server: RunQuery invoked! >2012-08-07 14:01:31,073 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,075 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,076 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) Server: RunQuery invoked! >2012-08-07 14:01:31,077 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,091 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) Server: RunQuery invoked! >2012-08-07 14:01:31,092 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,102 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-17) Server: RunQuery invoked! >2012-08-07 14:01:31,103 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) Server: RunQuery invoked! >2012-08-07 14:01:31,105 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,105 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-17) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,104 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) Server: RunQuery invoked! >2012-08-07 14:01:31,109 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,104 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-16) Server: RunQuery invoked! >2012-08-07 14:01:31,111 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-16) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,113 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-4) Server: RunQuery invoked! >2012-08-07 14:01:31,113 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-4) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,124 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) Server: RunQuery invoked! >2012-08-07 14:01:31,124 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,147 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) Server: RunQuery invoked! >2012-08-07 14:01:31,147 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,135 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) Server: RunQuery invoked! >2012-08-07 14:01:31,149 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,134 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) Server: RunQuery invoked! >2012-08-07 14:01:31,151 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,133 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) Server: RunQuery invoked! >2012-08-07 14:01:31,153 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,129 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) Server: RunQuery invoked! >2012-08-07 14:01:31,155 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,156 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) Server: RunQuery invoked! >2012-08-07 14:01:31,157 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,159 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) Server: RunQuery invoked! >2012-08-07 14:01:31,168 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,172 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) Server: RunQuery invoked! >2012-08-07 14:01:31,172 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,173 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) Server: RunQuery invoked! >2012-08-07 14:01:31,174 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,167 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-35) Server certificate 1: >2012-08-07 14:01:31,177 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-35) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:31,146 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) Server: RunQuery invoked! >2012-08-07 14:01:31,166 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) Server: RunQuery invoked! >2012-08-07 14:01:31,180 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,165 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) Server: RunQuery invoked! >2012-08-07 14:01:31,181 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,179 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) Server: RunQuery invoked! >2012-08-07 14:01:31,183 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,184 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,189 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) Server: RunQuery invoked! >2012-08-07 14:01:31,189 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,192 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) Server: RunQuery invoked! >2012-08-07 14:01:31,193 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,193 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-4) Server: RunQuery invoked! >2012-08-07 14:01:31,194 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-4) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,200 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) Server: RunQuery invoked! >2012-08-07 14:01:31,200 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,202 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-16) Server: RunQuery invoked! >2012-08-07 14:01:31,202 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-16) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,209 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-17) Server: RunQuery invoked! >2012-08-07 14:01:31,212 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-17) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,208 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) Server: RunQuery invoked! >2012-08-07 14:01:31,214 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,216 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) Server: RunQuery invoked! >2012-08-07 14:01:31,216 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,208 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-35) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:31,218 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-35) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:31,219 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) Server: RunQuery invoked! >2012-08-07 14:01:31,220 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,235 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-35) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:31,236 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-35) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:31,237 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-35) Server certificate 2: >2012-08-07 14:01:31,237 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-35) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:31,249 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-35) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:31,249 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-35) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:31,250 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-35) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:31,248 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) Server: RunQuery invoked! >2012-08-07 14:01:31,257 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,246 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) Server: RunQuery invoked! >2012-08-07 14:01:31,258 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,246 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) Server: RunQuery invoked! >2012-08-07 14:01:31,260 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,246 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) Server: RunQuery invoked! >2012-08-07 14:01:31,261 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,245 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) Server: RunQuery invoked! >2012-08-07 14:01:31,262 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,270 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) Server: RunQuery invoked! >2012-08-07 14:01:31,270 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,271 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) Server: RunQuery invoked! >2012-08-07 14:01:31,272 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,273 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) Server: RunQuery invoked! >2012-08-07 14:01:31,274 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,275 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-35) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:31,280 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) Server: RunQuery invoked! >2012-08-07 14:01:31,280 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,281 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) Server: RunQuery invoked! >2012-08-07 14:01:31,282 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,283 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-4) Server: RunQuery invoked! >2012-08-07 14:01:31,284 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-4) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,290 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) Server: RunQuery invoked! >2012-08-07 14:01:31,291 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,292 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) Server: RunQuery invoked! >2012-08-07 14:01:31,293 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,253 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (ajp--127.0.0.1-8009-16) Compiled stored procedure. Call string is [{call getpermissionsbyadelementid(?, ?, ?)}] >2012-08-07 14:01:31,299 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) Server: RunQuery invoked! >2012-08-07 14:01:31,305 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,299 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-17) Server: RunQuery invoked! >2012-08-07 14:01:31,306 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-17) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,308 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) Server: RunQuery invoked! >2012-08-07 14:01:31,308 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,294 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) Server: RunQuery invoked! >2012-08-07 14:01:31,309 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,293 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) Server: RunQuery invoked! >2012-08-07 14:01:31,311 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,318 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) Server: RunQuery invoked! >2012-08-07 14:01:31,319 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,321 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) Server: RunQuery invoked! >2012-08-07 14:01:31,321 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,322 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) Server: RunQuery invoked! >2012-08-07 14:01:31,323 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,324 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) Server: RunQuery invoked! >2012-08-07 14:01:31,325 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,331 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) Server: RunQuery invoked! >2012-08-07 14:01:31,332 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,333 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (ajp--127.0.0.1-8009-16) SqlCall for procedure [GetPermissionsByAdElementId] compiled >2012-08-07 14:01:31,340 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) Server: RunQuery invoked! >2012-08-07 14:01:31,341 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,344 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) Server: RunQuery invoked! >2012-08-07 14:01:31,345 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,350 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) Server: RunQuery invoked! >2012-08-07 14:01:31,350 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,353 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-4) Server: RunQuery invoked! >2012-08-07 14:01:31,353 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-4) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,359 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) Server: RunQuery invoked! >2012-08-07 14:01:31,359 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,367 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) Server: RunQuery invoked! >2012-08-07 14:01:31,368 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,370 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) Server: RunQuery invoked! >2012-08-07 14:01:31,370 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,372 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) Server: RunQuery invoked! >2012-08-07 14:01:31,373 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,376 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) Server: RunQuery invoked! >2012-08-07 14:01:31,376 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,379 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) Server: RunQuery invoked! >2012-08-07 14:01:31,380 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,382 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-17) Server: RunQuery invoked! >2012-08-07 14:01:31,383 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-17) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,386 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) Server: RunQuery invoked! >2012-08-07 14:01:31,386 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,395 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) Server: RunQuery invoked! >2012-08-07 14:01:31,396 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,397 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) Server: RunQuery invoked! >2012-08-07 14:01:31,398 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,396 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) Server: RunQuery invoked! >2012-08-07 14:01:31,400 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,403 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) Server: RunQuery invoked! >2012-08-07 14:01:31,404 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,409 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) Server: RunQuery invoked! >2012-08-07 14:01:31,410 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,412 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) Server: RunQuery invoked! >2012-08-07 14:01:31,415 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,417 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) Server: RunQuery invoked! >2012-08-07 14:01:31,418 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,422 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) Server: RunQuery invoked! >2012-08-07 14:01:31,425 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) Server: RunQuery invoked! >2012-08-07 14:01:31,425 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,424 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) Server: RunQuery invoked! >2012-08-07 14:01:31,426 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,432 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) Server: RunQuery invoked! >2012-08-07 14:01:31,432 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,438 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) Server: RunQuery invoked! >2012-08-07 14:01:31,438 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,439 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,443 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) Server: RunQuery invoked! >2012-08-07 14:01:31,443 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,449 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) Server: RunQuery invoked! >2012-08-07 14:01:31,450 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,456 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) Server: RunQuery invoked! >2012-08-07 14:01:31,457 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,467 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) Server: RunQuery invoked! >2012-08-07 14:01:31,467 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,468 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) Server: RunQuery invoked! >2012-08-07 14:01:31,469 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,470 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) Server: RunQuery invoked! >2012-08-07 14:01:31,472 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,469 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) Server: RunQuery invoked! >2012-08-07 14:01:31,473 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,481 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-37) START, SpmStatusVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23), log id: 4e4dfc1d >2012-08-07 14:01:31,483 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-17) Server: RunQuery invoked! >2012-08-07 14:01:31,484 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-17) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,484 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) Server: RunQuery invoked! >2012-08-07 14:01:31,485 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,488 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) Server: RunQuery invoked! >2012-08-07 14:01:31,489 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,495 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) Server: RunQuery invoked! >2012-08-07 14:01:31,495 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,496 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) Server: RunQuery invoked! >2012-08-07 14:01:31,497 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,504 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) Server: RunQuery invoked! >2012-08-07 14:01:31,504 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,505 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) Server: RunQuery invoked! >2012-08-07 14:01:31,506 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,507 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) Server: RunQuery invoked! >2012-08-07 14:01:31,508 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,515 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) Server: RunQuery invoked! >2012-08-07 14:01:31,515 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,516 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) Server: RunQuery invoked! >2012-08-07 14:01:31,517 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,522 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) Server: RunQuery invoked! >2012-08-07 14:01:31,523 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,525 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) Server: RunQuery invoked! >2012-08-07 14:01:31,526 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,531 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) Server: RunQuery invoked! >2012-08-07 14:01:31,531 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,539 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) Server: RunQuery invoked! >2012-08-07 14:01:31,540 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,543 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) Server: RunQuery invoked! >2012-08-07 14:01:31,543 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,552 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) Server: RunQuery invoked! >2012-08-07 14:01:31,552 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,553 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) Server: RunQuery invoked! >2012-08-07 14:01:31,554 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,555 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) Server: RunQuery invoked! >2012-08-07 14:01:31,556 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,561 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) Server: RunQuery invoked! >2012-08-07 14:01:31,562 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,562 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) Server: RunQuery invoked! >2012-08-07 14:01:31,563 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,570 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) Server: RunQuery invoked! >2012-08-07 14:01:31,570 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,571 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) Server: RunQuery invoked! >2012-08-07 14:01:31,572 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,578 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) Server: RunQuery invoked! >2012-08-07 14:01:31,578 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,579 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) Server: RunQuery invoked! >2012-08-07 14:01:31,580 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,582 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-36) Server certificate 1: >2012-08-07 14:01:31,582 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-36) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:31,583 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-36) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:31,587 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) Server: RunQuery invoked! >2012-08-07 14:01:31,587 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,588 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) Server: RunQuery invoked! >2012-08-07 14:01:31,589 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,590 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) Server: RunQuery invoked! >2012-08-07 14:01:31,591 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,598 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) Server: RunQuery invoked! >2012-08-07 14:01:31,599 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,601 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) Server: RunQuery invoked! >2012-08-07 14:01:31,606 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,599 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) Server: RunQuery invoked! >2012-08-07 14:01:31,607 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,615 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) Server: RunQuery invoked! >2012-08-07 14:01:31,616 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,616 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) Server: RunQuery invoked! >2012-08-07 14:01:31,619 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,625 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-36) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:31,626 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) Server: RunQuery invoked! >2012-08-07 14:01:31,627 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,629 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) Server: RunQuery invoked! >2012-08-07 14:01:31,630 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,635 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) Server: RunQuery invoked! >2012-08-07 14:01:31,635 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,641 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) Server: RunQuery invoked! >2012-08-07 14:01:31,641 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,649 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) Server: RunQuery invoked! >2012-08-07 14:01:31,649 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,652 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) Server: RunQuery invoked! >2012-08-07 14:01:31,652 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,655 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) Server: RunQuery invoked! >2012-08-07 14:01:31,656 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,648 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-36) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:31,662 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) Server: RunQuery invoked! >2012-08-07 14:01:31,663 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,668 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-36) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:31,669 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) Server: RunQuery invoked! >2012-08-07 14:01:31,670 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,668 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) Server: RunQuery invoked! >2012-08-07 14:01:31,671 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,677 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) Server: RunQuery invoked! >2012-08-07 14:01:31,678 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,679 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) Server: RunQuery invoked! >2012-08-07 14:01:31,679 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,682 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) Server: RunQuery invoked! >2012-08-07 14:01:31,683 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,687 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) Server: RunQuery invoked! >2012-08-07 14:01:31,687 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,689 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) Server: RunQuery invoked! >2012-08-07 14:01:31,690 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,690 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) Server: RunQuery invoked! >2012-08-07 14:01:31,691 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,698 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) Server: RunQuery invoked! >2012-08-07 14:01:31,699 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,700 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-36) Server certificate 2: >2012-08-07 14:01:31,703 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-36) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:31,704 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-36) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:31,704 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-36) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:31,705 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-36) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:31,700 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) Server: RunQuery invoked! >2012-08-07 14:01:31,720 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,699 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) Server: RunQuery invoked! >2012-08-07 14:01:31,722 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,706 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-35) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@2e0e93d0, log id: 7381ab33 >2012-08-07 14:01:31,725 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) Server: RunQuery invoked! >2012-08-07 14:01:31,725 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,730 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) Server: RunQuery invoked! >2012-08-07 14:01:31,731 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,734 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) Server: RunQuery invoked! >2012-08-07 14:01:31,736 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,736 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) Server: RunQuery invoked! >2012-08-07 14:01:31,737 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,744 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) Server: RunQuery invoked! >2012-08-07 14:01:31,744 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,745 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) Server: RunQuery invoked! >2012-08-07 14:01:31,746 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,747 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) Server: RunQuery invoked! >2012-08-07 14:01:31,748 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,754 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) Server: RunQuery invoked! >2012-08-07 14:01:31,755 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,755 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) Server: RunQuery invoked! >2012-08-07 14:01:31,756 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,760 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) Server: RunQuery invoked! >2012-08-07 14:01:31,762 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,764 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) Server: RunQuery invoked! >2012-08-07 14:01:31,765 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,766 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) Server: RunQuery invoked! >2012-08-07 14:01:31,766 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,769 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) Server: RunQuery invoked! >2012-08-07 14:01:31,770 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,771 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) Server: RunQuery invoked! >2012-08-07 14:01:31,772 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,775 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-36) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:31,782 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) Server: RunQuery invoked! >2012-08-07 14:01:31,783 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,789 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) Server: RunQuery invoked! >2012-08-07 14:01:31,789 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,795 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) Server: RunQuery invoked! >2012-08-07 14:01:31,796 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,803 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) Server: RunQuery invoked! >2012-08-07 14:01:31,803 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,805 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) Server: RunQuery invoked! >2012-08-07 14:01:31,806 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,809 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) Server: RunQuery invoked! >2012-08-07 14:01:31,810 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,817 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) Server: RunQuery invoked! >2012-08-07 14:01:31,817 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,823 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) Server: RunQuery invoked! >2012-08-07 14:01:31,823 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,833 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) Server: RunQuery invoked! >2012-08-07 14:01:31,834 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,834 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) Server: RunQuery invoked! >2012-08-07 14:01:31,836 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:31,842 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-36) vds::refreshVmList entered >2012-08-07 14:01:31,877 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-37) Server certificate 1: >2012-08-07 14:01:31,878 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-37) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:31,878 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-37) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:31,879 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-37) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:31,902 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-37) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:31,903 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-37) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:31,903 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-37) Server certificate 2: >2012-08-07 14:01:31,904 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-37) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:31,913 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-37) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:31,913 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-37) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:31,914 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-37) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:31,914 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-37) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:31,942 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-37) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@36145192, log id: 4e4dfc1d >2012-08-07 14:01:31,945 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-37) START, GetStoragePoolInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 2c2fecc9 >2012-08-07 14:01:31,984 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-38) Server certificate 1: >2012-08-07 14:01:31,984 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-38) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:31,985 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-38) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:31,992 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-38) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:31,993 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-38) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:31,993 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-38) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:31,994 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-38) Server certificate 2: >2012-08-07 14:01:32,011 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-38) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:32,011 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-38) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:32,012 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-38) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:32,016 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-38) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:32,017 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-38) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:32,050 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-38) vdsManager::refreshVdsStats entered, vds = 4196a566-dee6-11e1-b66e-c35c5273fee7 : purple-vds2 >2012-08-07 14:01:32,051 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-38) START, GetStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@514fb62e), log id: 17802f87 >2012-08-07 14:01:32,062 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-39) Server certificate 1: >2012-08-07 14:01:32,063 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-39) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:32,063 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-39) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:32,064 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-39) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:32,066 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-39) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:32,066 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-39) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:32,070 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-39) Server certificate 2: >2012-08-07 14:01:32,071 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-39) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:32,071 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-39) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:32,072 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-39) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:32,072 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-39) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:32,072 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-39) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:32,079 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-37) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@5d2d4c1, log id: 2c2fecc9 >2012-08-07 14:01:32,163 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-38) FINISH, GetStatsVDSCommand, log id: 17802f87 >2012-08-07 14:01:32,187 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-38) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@5a1139ef >2012-08-07 14:01:32,188 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-38) vds::refreshVmList entered >2012-08-07 14:01:32,189 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-38) START, GetAllVmStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@832b0ba9), log id: 20f2a81b >2012-08-07 14:01:32,199 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-40) Server certificate 1: >2012-08-07 14:01:32,200 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-40) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:32,200 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-40) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:32,201 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-40) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:32,205 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-40) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:32,206 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-40) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:32,206 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-40) Server certificate 2: >2012-08-07 14:01:32,207 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-40) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:32,211 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-40) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:32,211 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-40) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:32,212 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-40) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:32,214 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-40) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:32,380 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-38) FINISH, GetAllVmStatsVDSCommand, return: {6c1fcddf-86d6-4533-905b-abb11b775f5b=org.ovirt.engine.core.compat.KeyValuePairCompat@c227b513, 2842672f-6230-434f-8232-e88e71560092=org.ovirt.engine.core.compat.KeyValuePairCompat@6256c250, e5a192f1-3f9d-48e1-a817-28f72815c646=org.ovirt.engine.core.compat.KeyValuePairCompat@f48a30de, 8738bb81-c73e-4a41-a24a-c4c49491c536=org.ovirt.engine.core.compat.KeyValuePairCompat@b894708e, 6a729fb0-47fe-4eba-9ba3-2b939eee2b19=org.ovirt.engine.core.compat.KeyValuePairCompat@d8e31755, ba81adbe-b311-4aef-b6c1-5f84f0f3c94d=org.ovirt.engine.core.compat.KeyValuePairCompat@a5097a89, 54b872c6-cefc-4a19-b48e-9bc1a09285f9=org.ovirt.engine.core.compat.KeyValuePairCompat@dc261e7e, 9dbe6b1e-2a98-449e-8bd7-2d025c420a42=org.ovirt.engine.core.compat.KeyValuePairCompat@45636a21}, log id: 20f2a81b >2012-08-07 14:01:34,080 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-39) vdsManager::refreshVdsStats entered, vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3 >2012-08-07 14:01:34,081 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-39) START, GetStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@ed1594d7), log id: 1a0ad635 >2012-08-07 14:01:34,099 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-41) Server certificate 1: >2012-08-07 14:01:34,100 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-41) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:34,100 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-41) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:34,101 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-41) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:34,103 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-41) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:34,104 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-41) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:34,105 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-41) Server certificate 2: >2012-08-07 14:01:34,105 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-41) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:34,110 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-41) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:34,112 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-41) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:34,113 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-41) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:34,113 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-41) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:34,170 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-39) FINISH, GetStatsVDSCommand, log id: 1a0ad635 >2012-08-07 14:01:34,180 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-39) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@75e6b3d8 >2012-08-07 14:01:34,181 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-39) vds::refreshVmList entered >2012-08-07 14:01:34,181 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-39) START, GetAllVmStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@301712f6), log id: 7d296660 >2012-08-07 14:01:34,193 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-42) Server certificate 1: >2012-08-07 14:01:34,194 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-42) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:34,194 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-42) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:34,195 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-42) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:34,195 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-42) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:34,196 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-42) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:34,196 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-42) Server certificate 2: >2012-08-07 14:01:34,197 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-42) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:34,197 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-42) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:34,198 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-42) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:34,198 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-42) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:34,198 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-42) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:34,215 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-39) FINISH, GetAllVmStatsVDSCommand, return: {}, log id: 7d296660 >2012-08-07 14:01:34,535 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) Server: RunQuery invoked! >2012-08-07 14:01:34,536 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:34,543 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) Server: RunQuery invoked! >2012-08-07 14:01:34,544 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:34,555 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (ajp--127.0.0.1-8009-14) Compiled stored procedure. Call string is [{call getallfrombookmarks()}] >2012-08-07 14:01:34,556 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) Server: RunQuery invoked! >2012-08-07 14:01:34,562 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:34,565 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (ajp--127.0.0.1-8009-14) SqlCall for procedure [GetAllFromBookmarks] compiled >2012-08-07 14:01:34,585 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-5) ResourceManager::searchBusinessObjects(DataCenter: sortby name) - entered >2012-08-07 14:01:34,601 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-40) vds::refreshVmList entered >2012-08-07 14:01:34,622 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-43) Server certificate 1: >2012-08-07 14:01:34,623 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-43) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:34,623 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-43) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:34,624 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-43) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:34,624 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-43) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:34,633 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-43) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:34,634 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-43) Server certificate 2: >2012-08-07 14:01:34,634 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-43) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:34,635 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-43) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:34,641 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-43) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:34,642 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-43) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:34,642 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-43) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:34,718 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-5) Adding new value to configuration cache. >2012-08-07 14:01:34,719 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-5) Didnt find the value of DBPagingType in DB for version general - using default: Offset >2012-08-07 14:01:34,720 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-5) Adding new value to configuration cache. >2012-08-07 14:01:34,721 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-5) Didnt find the value of DBPagingSyntax in DB for version general - using default: OFFSET (%1$s -1) LIMIT %2$s >2012-08-07 14:01:34,722 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-5) Adding new value to configuration cache. >2012-08-07 14:01:34,726 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp--127.0.0.1-8009-5) Didnt find the value of DBSearchTemplate in DB for version general - using default: SELECT * FROM (%2$s) %1$s) as T1 %3$s >2012-08-07 14:01:34,974 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) Server: RunQuery invoked! >2012-08-07 14:01:34,975 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:34,995 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (ajp--127.0.0.1-8009-1) Compiled stored procedure. Call string is [{call getallfromvdsgroups(?, ?)}] >2012-08-07 14:01:34,996 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (ajp--127.0.0.1-8009-1) SqlCall for procedure [GetAllFromVdsGroups] compiled >2012-08-07 14:01:35,199 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) Server: RunQuery invoked! >2012-08-07 14:01:35,200 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:35,202 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-12) ResourceManager::searchBusinessObjects(Host: ) - entered >2012-08-07 14:01:35,348 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) Server: RunMultipleQuery invoked! [amount of queries: 6] >2012-08-07 14:01:35,354 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) Server: RunQuery invoked! >2012-08-07 14:01:35,354 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:35,365 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) Server: RunQuery invoked! >2012-08-07 14:01:35,366 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:35,375 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) Server: RunQuery invoked! >2012-08-07 14:01:35,375 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:35,380 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) Server: RunQuery invoked! >2012-08-07 14:01:35,381 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:35,388 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) Server: RunQuery invoked! >2012-08-07 14:01:35,389 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:35,419 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) Server: RunQuery invoked! >2012-08-07 14:01:35,419 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:35,457 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) VdcQueryReturnValue: org.ovirt.engine.core.common.queries.VdcQueryReturnValue@412afdef >2012-08-07 14:01:35,457 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) VdcQueryReturnValue: org.ovirt.engine.core.common.queries.VdcQueryReturnValue@6d857755 >2012-08-07 14:01:35,458 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) VdcQueryReturnValue: org.ovirt.engine.core.common.queries.VdcQueryReturnValue@555da59f >2012-08-07 14:01:35,459 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) VdcQueryReturnValue: org.ovirt.engine.core.common.queries.VdcQueryReturnValue@77249581 >2012-08-07 14:01:35,460 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) VdcQueryReturnValue: org.ovirt.engine.core.common.queries.VdcQueryReturnValue@2d38543 >2012-08-07 14:01:35,461 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) VdcQueryReturnValue: org.ovirt.engine.core.common.queries.VdcQueryReturnValue@cd1f328 >2012-08-07 14:01:35,461 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) Server: RunMultipleQuery result [amount of queries: 6] >2012-08-07 14:01:35,555 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) Server: RunQuery invoked! >2012-08-07 14:01:35,555 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:35,559 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Vms:) - entered >2012-08-07 14:01:35,754 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) Server: RunQuery invoked! >2012-08-07 14:01:35,754 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) IP [10.35.3.239], Session ID [sqUHlFMvT6Y0lD2fF8nm+o05.undefined] >2012-08-07 14:01:35,768 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) Server: RunQuery invoked! >2012-08-07 14:01:35,769 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) IP [10.35.3.239], Session ID [jmPBXs9cXUOonFcWXtMMzEUr.undefined] >2012-08-07 14:01:35,899 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) Server: RunQuery invoked! >2012-08-07 14:01:35,904 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:35,905 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) Server: RunQuery invoked! >2012-08-07 14:01:35,906 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:35,917 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (ajp--127.0.0.1-8009-2) Compiled stored procedure. Call string is [{call getallfromrole()}] >2012-08-07 14:01:35,917 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (ajp--127.0.0.1-8009-2) SqlCall for procedure [GetAllFromRole] compiled >2012-08-07 14:01:35,920 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (ajp--127.0.0.1-8009-13) Compiled stored procedure. Call string is [{call getpermissionsbyentityid(?, ?, ?)}] >2012-08-07 14:01:35,920 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (ajp--127.0.0.1-8009-13) SqlCall for procedure [GetPermissionsByEntityId] compiled >2012-08-07 14:01:36,331 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-41) vds::refreshVmList entered >2012-08-07 14:01:36,336 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-44) Server certificate 1: >2012-08-07 14:01:36,337 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-44) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:36,337 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-44) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:36,338 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-44) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:36,339 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-44) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:36,339 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-44) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:36,345 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-44) Server certificate 2: >2012-08-07 14:01:36,345 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-44) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:36,346 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-44) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:36,346 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-44) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:36,347 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-44) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:36,347 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-44) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:36,704 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-42) vds::refreshVmList entered >2012-08-07 14:01:36,715 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-45) Server certificate 1: >2012-08-07 14:01:36,715 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-45) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:36,716 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-45) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:36,716 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-45) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:36,717 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-45) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:36,717 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-45) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:36,718 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-45) Server certificate 2: >2012-08-07 14:01:36,718 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-45) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:36,719 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-45) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:36,722 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-45) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:36,723 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-45) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:36,723 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-45) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:38,394 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-43) vds::refreshVmList entered >2012-08-07 14:01:38,398 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-46) Server certificate 1: >2012-08-07 14:01:38,399 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-46) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:38,399 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-46) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:38,400 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-46) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:38,404 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-46) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:38,405 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-46) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:38,405 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-46) Server certificate 2: >2012-08-07 14:01:38,406 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-46) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:38,407 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-46) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:38,407 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-46) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:38,409 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-46) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:38,409 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-46) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:38,772 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-44) vds::refreshVmList entered >2012-08-07 14:01:38,785 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-47) Server certificate 1: >2012-08-07 14:01:38,786 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-47) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:38,786 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-47) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:38,787 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-47) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:38,787 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-47) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:38,788 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-47) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:38,788 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-47) Server certificate 2: >2012-08-07 14:01:38,789 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-47) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:38,789 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-47) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:38,790 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-47) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:38,794 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-47) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:38,795 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-47) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:39,540 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) Server: RunQuery invoked! >2012-08-07 14:01:39,540 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:39,542 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:01:40,449 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-51) vds::refreshVmList entered >2012-08-07 14:01:40,457 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-48) Server certificate 1: >2012-08-07 14:01:40,457 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-48) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:40,458 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-48) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:40,458 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-48) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:40,459 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-48) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:40,459 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-48) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:40,459 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-48) Server certificate 2: >2012-08-07 14:01:40,460 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-48) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:40,460 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-48) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:40,461 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-48) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:40,464 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-48) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:40,465 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-48) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:40,565 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) Server: RunQuery invoked! >2012-08-07 14:01:40,565 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:40,805 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) Server: RunQuery invoked! >2012-08-07 14:01:40,805 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:40,808 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) Server: RunQuery invoked! >2012-08-07 14:01:40,808 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:40,832 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-52) vds::refreshVmList entered >2012-08-07 14:01:40,843 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:01:40,844 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:40,844 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:40,845 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:40,847 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:40,848 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:40,848 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:01:40,849 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:40,854 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:40,855 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:40,855 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:40,856 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:41,974 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-53) START, SpmStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f), log id: 584afb0c >2012-08-07 14:01:41,983 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:01:41,984 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:41,984 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:41,985 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:41,985 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:41,985 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:41,986 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:01:41,986 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:41,987 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:41,987 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:41,988 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:41,989 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:42,012 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-53) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7085cbe2, log id: 584afb0c >2012-08-07 14:01:42,014 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-53) START, GetStoragePoolInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 49e7d35a >2012-08-07 14:01:42,019 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:01:42,019 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:42,020 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:42,020 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:42,021 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:42,021 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:42,030 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:01:42,030 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:42,030 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:42,031 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:42,031 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:42,032 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:42,071 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-53) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@2e0e93d0, log id: 49e7d35a >2012-08-07 14:01:42,355 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-54) START, SpmStatusVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23), log id: bfa164 >2012-08-07 14:01:42,364 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:01:42,365 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:42,365 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:42,366 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:42,366 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:42,367 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:42,367 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:01:42,367 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:42,368 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:42,369 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:42,374 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:42,374 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:42,408 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-54) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@24fcac9e, log id: bfa164 >2012-08-07 14:01:42,410 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-54) START, GetStoragePoolInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 523888f3 >2012-08-07 14:01:42,415 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:01:42,415 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:42,416 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:42,416 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:42,416 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:42,417 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:42,418 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:01:42,423 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:42,424 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:42,425 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:42,425 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:42,425 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:42,464 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-54) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@5d2d4c1, log id: 523888f3 >2012-08-07 14:01:42,495 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-55) vds::refreshVmList entered >2012-08-07 14:01:42,503 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:01:42,504 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:42,504 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:42,505 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:42,505 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:42,507 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:42,508 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:01:42,508 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:42,516 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:42,517 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:42,517 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:42,518 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:42,900 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-56) vdsManager::refreshVdsStats entered, vds = 4196a566-dee6-11e1-b66e-c35c5273fee7 : purple-vds2 >2012-08-07 14:01:42,901 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-56) START, GetStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@390a1b65), log id: e69f761 >2012-08-07 14:01:42,906 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:01:42,906 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:42,906 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:42,907 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:42,908 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:42,908 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:42,909 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:01:42,909 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:42,910 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:42,910 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:42,911 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:42,911 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:42,937 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-56) FINISH, GetStatsVDSCommand, log id: e69f761 >2012-08-07 14:01:42,940 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-56) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@c331faa >2012-08-07 14:01:42,941 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-56) vds::refreshVmList entered >2012-08-07 14:01:42,941 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-56) START, GetAllVmStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@23582bfe), log id: 7063d827 >2012-08-07 14:01:42,945 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:01:42,945 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:42,946 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:42,946 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:42,947 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:42,947 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:42,948 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:01:42,948 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:42,949 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:42,949 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:42,950 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:42,950 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:43,027 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-56) FINISH, GetAllVmStatsVDSCommand, return: {6c1fcddf-86d6-4533-905b-abb11b775f5b=org.ovirt.engine.core.compat.KeyValuePairCompat@34641f13, 2842672f-6230-434f-8232-e88e71560092=org.ovirt.engine.core.compat.KeyValuePairCompat@a84cf723, e5a192f1-3f9d-48e1-a817-28f72815c646=org.ovirt.engine.core.compat.KeyValuePairCompat@d0c11cde, 8738bb81-c73e-4a41-a24a-c4c49491c536=org.ovirt.engine.core.compat.KeyValuePairCompat@c7808d8b, 6a729fb0-47fe-4eba-9ba3-2b939eee2b19=org.ovirt.engine.core.compat.KeyValuePairCompat@e7cf3452, ba81adbe-b311-4aef-b6c1-5f84f0f3c94d=org.ovirt.engine.core.compat.KeyValuePairCompat@81406689, 54b872c6-cefc-4a19-b48e-9bc1a09285f9=org.ovirt.engine.core.compat.KeyValuePairCompat@7aa8bdab, 9dbe6b1e-2a98-449e-8bd7-2d025c420a42=org.ovirt.engine.core.compat.KeyValuePairCompat@b79fd421}, log id: 7063d827 >2012-08-07 14:01:44,579 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) Server: RunQuery invoked! >2012-08-07 14:01:44,580 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:44,581 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:01:44,585 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-57) vdsManager::refreshVdsStats entered, vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3 >2012-08-07 14:01:44,588 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-57) START, GetStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@f780436c), log id: 3eb53fd3 >2012-08-07 14:01:44,600 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:01:44,601 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:44,601 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:44,602 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:44,602 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:44,603 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:44,603 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:01:44,604 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:44,608 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:44,609 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:44,609 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:44,610 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:44,658 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-57) FINISH, GetStatsVDSCommand, log id: 3eb53fd3 >2012-08-07 14:01:44,660 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-57) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@dccd7d3 >2012-08-07 14:01:44,661 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-57) vds::refreshVmList entered >2012-08-07 14:01:44,661 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-57) START, GetAllVmStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@e9739cd6), log id: 36d64b9 >2012-08-07 14:01:44,666 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:01:44,667 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:44,667 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:44,668 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:44,668 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:44,668 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:44,670 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:01:44,670 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:44,671 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:44,671 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:44,672 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:44,672 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:44,688 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-57) FINISH, GetAllVmStatsVDSCommand, return: {}, log id: 36d64b9 >2012-08-07 14:01:45,257 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-58) vds::refreshVmList entered >2012-08-07 14:01:45,261 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:01:45,261 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:45,262 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:45,262 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:45,263 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:45,263 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:45,264 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:01:45,264 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:45,265 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:45,268 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:45,268 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:45,271 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:45,562 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-4) Server: RunQuery invoked! >2012-08-07 14:01:45,562 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-4) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:45,844 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-17) Server: RunQuery invoked! >2012-08-07 14:01:45,845 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-17) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:45,847 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-16) Server: RunQuery invoked! >2012-08-07 14:01:45,847 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-16) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:46,785 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-59) vds::refreshVmList entered >2012-08-07 14:01:46,789 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:01:46,789 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:46,792 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:46,796 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:46,797 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:46,797 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:46,798 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:01:46,798 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:46,798 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:46,799 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:46,799 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:46,800 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:47,302 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-60) vds::refreshVmList entered >2012-08-07 14:01:47,307 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:01:47,307 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:47,307 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:47,308 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:47,308 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:47,309 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:47,309 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:01:47,310 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:47,310 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:47,311 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:47,311 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:47,311 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:48,832 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-61) vds::refreshVmList entered >2012-08-07 14:01:48,843 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:01:48,843 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:48,844 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:48,844 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:48,845 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:48,845 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:48,845 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:01:48,849 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:48,850 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:48,850 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:48,851 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:48,851 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:49,354 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-62) vds::refreshVmList entered >2012-08-07 14:01:49,358 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:01:49,359 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:49,359 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:49,360 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:49,360 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:49,361 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:49,361 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:01:49,361 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:49,362 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:49,363 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:49,363 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:49,366 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:49,602 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) Server: RunQuery invoked! >2012-08-07 14:01:49,603 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:49,604 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:01:50,546 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) Server: RunQuery invoked! >2012-08-07 14:01:50,546 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:50,811 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) Server: RunQuery invoked! >2012-08-07 14:01:50,812 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:50,813 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) Server: RunQuery invoked! >2012-08-07 14:01:50,816 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:50,924 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-68) vds::refreshVmList entered >2012-08-07 14:01:50,928 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:01:50,929 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:50,929 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:50,930 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:50,930 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:50,931 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:50,931 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:01:50,932 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:50,932 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:50,933 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:50,933 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:50,939 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:51,399 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-69) vds::refreshVmList entered >2012-08-07 14:01:51,402 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:01:51,403 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:51,403 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:51,403 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:51,404 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:51,407 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:51,408 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:01:51,408 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:51,409 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:51,409 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:51,410 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:51,410 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:52,154 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-70) START, SpmStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f), log id: 4749be63 >2012-08-07 14:01:52,164 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:01:52,165 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:52,165 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:52,166 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:52,168 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:52,170 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:52,171 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:01:52,171 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:52,172 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:52,172 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:52,179 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:52,180 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:52,209 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-70) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3a727a25, log id: 4749be63 >2012-08-07 14:01:52,211 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-70) START, GetStoragePoolInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 4d7950d9 >2012-08-07 14:01:52,220 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:01:52,220 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:52,220 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:52,221 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:52,221 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:52,222 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:52,222 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:01:52,223 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:52,223 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:52,224 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:52,227 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:52,228 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:52,266 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-70) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@2e0e93d0, log id: 4d7950d9 >2012-08-07 14:01:52,616 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-71) START, SpmStatusVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23), log id: 232a8e08 >2012-08-07 14:01:52,621 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:01:52,622 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:52,622 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:52,622 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:52,623 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:52,623 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:52,624 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:01:52,624 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:52,625 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:52,625 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:52,626 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:52,626 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:52,650 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-71) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3ed2c141, log id: 232a8e08 >2012-08-07 14:01:52,652 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-71) START, GetStoragePoolInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 29681c39 >2012-08-07 14:01:52,656 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:01:52,656 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:52,657 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:52,657 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:52,658 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:52,658 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:52,659 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:01:52,659 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:52,659 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:52,660 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:52,663 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:52,664 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:52,700 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-71) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@5d2d4c1, log id: 29681c39 >2012-08-07 14:01:52,976 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-72) vds::refreshVmList entered >2012-08-07 14:01:52,981 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:01:52,981 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:52,982 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:52,982 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:52,983 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:52,983 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:52,984 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:01:52,984 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:52,985 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:52,986 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:52,986 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:52,986 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:53,445 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-73) vdsManager::refreshVdsStats entered, vds = 4196a566-dee6-11e1-b66e-c35c5273fee7 : purple-vds2 >2012-08-07 14:01:53,448 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-73) START, GetStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@bc0997a5), log id: 20ddc966 >2012-08-07 14:01:53,452 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:01:53,453 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:53,453 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:53,454 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:53,454 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:53,455 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:53,455 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:01:53,456 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:53,456 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:53,457 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:53,462 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:53,463 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:53,516 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-73) FINISH, GetStatsVDSCommand, log id: 20ddc966 >2012-08-07 14:01:53,530 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-73) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@156254d8 >2012-08-07 14:01:53,530 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-73) vds::refreshVmList entered >2012-08-07 14:01:53,531 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-73) START, GetAllVmStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@cb9a1ef1), log id: 6ab03bdf >2012-08-07 14:01:53,535 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:01:53,535 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:53,536 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:53,536 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:53,537 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:53,537 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:53,538 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:01:53,543 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:53,544 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:53,544 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:53,545 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:53,548 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:53,681 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-73) FINISH, GetAllVmStatsVDSCommand, return: {6c1fcddf-86d6-4533-905b-abb11b775f5b=org.ovirt.engine.core.compat.KeyValuePairCompat@a6a08913, 2842672f-6230-434f-8232-e88e71560092=org.ovirt.engine.core.compat.KeyValuePairCompat@1a896123, e5a192f1-3f9d-48e1-a817-28f72815c646=org.ovirt.engine.core.compat.KeyValuePairCompat@42fd86de, 8738bb81-c73e-4a41-a24a-c4c49491c536=org.ovirt.engine.core.compat.KeyValuePairCompat@a3b7798b, 6a729fb0-47fe-4eba-9ba3-2b939eee2b19=org.ovirt.engine.core.compat.KeyValuePairCompat@5a0b9e52, ba81adbe-b311-4aef-b6c1-5f84f0f3c94d=org.ovirt.engine.core.compat.KeyValuePairCompat@f37cd089, 54b872c6-cefc-4a19-b48e-9bc1a09285f9=org.ovirt.engine.core.compat.KeyValuePairCompat@56dfa9ab, 9dbe6b1e-2a98-449e-8bd7-2d025c420a42=org.ovirt.engine.core.compat.KeyValuePairCompat@29dc3e21}, log id: 6ab03bdf >2012-08-07 14:01:54,555 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) Server: RunQuery invoked! >2012-08-07 14:01:54,555 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:54,556 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:01:55,021 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-74) vdsManager::refreshVdsStats entered, vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3 >2012-08-07 14:01:55,022 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-74) START, GetStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@ce96c4d8), log id: 1d1a7dfd >2012-08-07 14:01:55,031 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:01:55,032 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:55,032 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:55,033 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:55,034 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:55,035 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:55,036 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:01:55,036 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:55,037 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:55,037 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:55,040 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:55,041 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:55,088 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-74) FINISH, GetStatsVDSCommand, log id: 1d1a7dfd >2012-08-07 14:01:55,090 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-74) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@258c24e3 >2012-08-07 14:01:55,091 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-74) vds::refreshVmList entered >2012-08-07 14:01:55,091 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-74) START, GetAllVmStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@db12c544), log id: 13c9c657 >2012-08-07 14:01:55,096 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:01:55,096 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:55,097 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:55,097 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:55,098 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:55,098 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:55,099 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:01:55,099 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:55,100 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:55,100 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:55,101 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:55,101 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:55,118 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-74) FINISH, GetAllVmStatsVDSCommand, return: {}, log id: 13c9c657 >2012-08-07 14:01:55,565 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) Server: RunQuery invoked! >2012-08-07 14:01:55,565 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:55,810 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) Server: RunQuery invoked! >2012-08-07 14:01:55,810 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:55,814 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) Server: RunQuery invoked! >2012-08-07 14:01:55,815 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:55,922 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-75) vds::refreshVmList entered >2012-08-07 14:01:55,925 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:01:55,926 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:55,926 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:55,926 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:55,927 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:55,927 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:55,928 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:01:55,928 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:55,929 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:55,933 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:55,933 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:55,934 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:57,248 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) vds::refreshVmList entered >2012-08-07 14:01:57,259 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:01:57,260 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:57,260 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:57,261 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:57,261 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:57,262 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:57,262 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:01:57,263 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:57,263 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:57,264 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:57,264 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:57,268 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:57,975 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-77) vds::refreshVmList entered >2012-08-07 14:01:57,986 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:01:57,987 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:57,987 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:57,987 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:01:57,988 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:01:57,988 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:57,989 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:01:57,989 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:57,990 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:57,993 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:57,994 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:57,994 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:59,304 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-78) vds::refreshVmList entered >2012-08-07 14:01:59,312 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:01:59,312 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:01:59,312 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:59,313 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:01:59,313 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:01:59,314 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:59,314 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:01:59,315 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:59,315 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:01:59,315 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:01:59,316 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:01:59,316 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:01:59,567 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) Server: RunQuery invoked! >2012-08-07 14:01:59,568 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:01:59,569 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:02:00,039 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-84) vds::refreshVmList entered >2012-08-07 14:02:00,043 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:00,044 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:00,046 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:00,047 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:00,047 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:00,047 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:00,051 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:00,051 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:00,052 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:00,052 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:00,055 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:00,056 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:00,816 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) Server: RunQuery invoked! >2012-08-07 14:02:00,817 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) Server: RunQuery invoked! >2012-08-07 14:02:00,818 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:00,819 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:01,359 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-85) vds::refreshVmList entered >2012-08-07 14:02:01,363 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:01,364 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:01,364 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:01,365 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:01,365 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:01,365 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:01,366 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:01,366 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:01,367 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:01,367 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:01,368 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:01,368 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:02,091 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-86) vds::refreshVmList entered >2012-08-07 14:02:02,095 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:02,096 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:02,096 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:02,097 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:02,097 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:02,097 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:02,098 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:02,098 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:02,101 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:02,102 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:02,102 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:02,103 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:02,414 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-87) START, SpmStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f), log id: 7087bccb >2012-08-07 14:02:02,418 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:02,419 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:02,419 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:02,420 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:02,420 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:02,420 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:02,422 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:02,422 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:02,423 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:02,423 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:02,423 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:02,424 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:02,449 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-87) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5f7bed24, log id: 7087bccb >2012-08-07 14:02:02,451 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-87) START, GetStoragePoolInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 77b1cdac >2012-08-07 14:02:02,454 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:02,455 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:02,455 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:02,455 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:02,456 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:02,456 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:02,457 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:02,457 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:02,458 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:02,458 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:02,458 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:02,459 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:02,485 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-87) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@2e0e93d0, log id: 77b1cdac >2012-08-07 14:02:02,847 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-88) START, SpmStatusVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23), log id: 3e9d0fe8 >2012-08-07 14:02:02,853 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:02,853 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:02,853 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:02,854 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:02,854 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:02,855 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:02,855 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:02,856 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:02,856 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:02,857 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:02,857 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:02,857 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:02,887 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-88) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@397f6875, log id: 3e9d0fe8 >2012-08-07 14:02:02,889 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-88) START, GetStoragePoolInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 5ee4ae27 >2012-08-07 14:02:02,896 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:02,896 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:02,897 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:02,897 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:02,898 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:02,898 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:02,903 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:02,904 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:02,904 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:02,905 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:02,905 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:02,906 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:02,962 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-88) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@5d2d4c1, log id: 5ee4ae27 >2012-08-07 14:02:03,395 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-89) vds::refreshVmList entered >2012-08-07 14:02:03,400 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:03,400 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:03,401 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:03,401 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:03,401 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:03,402 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:03,404 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:03,405 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:03,405 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:03,406 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:03,406 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:03,407 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:04,149 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-90) vdsManager::refreshVdsStats entered, vds = 4196a566-dee6-11e1-b66e-c35c5273fee7 : purple-vds2 >2012-08-07 14:02:04,152 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-90) START, GetStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@390a1b65), log id: 6fad53cf >2012-08-07 14:02:04,156 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:04,157 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:04,157 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:04,158 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:04,158 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:04,158 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:04,159 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:04,159 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:04,160 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:04,160 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:04,168 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:04,169 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:04,224 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-90) FINISH, GetStatsVDSCommand, log id: 6fad53cf >2012-08-07 14:02:04,226 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-90) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@610781fb >2012-08-07 14:02:04,227 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-90) vds::refreshVmList entered >2012-08-07 14:02:04,227 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-90) START, GetAllVmStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@ffd0aa7f), log id: 33e6b781 >2012-08-07 14:02:04,235 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:04,235 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:04,236 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:04,236 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:04,237 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:04,240 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:04,240 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:04,241 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:04,241 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:04,242 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:04,245 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:04,245 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:04,335 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-90) FINISH, GetAllVmStatsVDSCommand, return: {6c1fcddf-86d6-4533-905b-abb11b775f5b=org.ovirt.engine.core.compat.KeyValuePairCompat@725795cc, 2842672f-6230-434f-8232-e88e71560092=org.ovirt.engine.core.compat.KeyValuePairCompat@23068250, e5a192f1-3f9d-48e1-a817-28f72815c646=org.ovirt.engine.core.compat.KeyValuePairCompat@b539f0de, 8738bb81-c73e-4a41-a24a-c4c49491c536=org.ovirt.engine.core.compat.KeyValuePairCompat@15f3e38b, 6a729fb0-47fe-4eba-9ba3-2b939eee2b19=org.ovirt.engine.core.compat.KeyValuePairCompat@36428a52, ba81adbe-b311-4aef-b6c1-5f84f0f3c94d=org.ovirt.engine.core.compat.KeyValuePairCompat@65b93a89, 54b872c6-cefc-4a19-b48e-9bc1a09285f9=org.ovirt.engine.core.compat.KeyValuePairCompat@c91c13ab, 9dbe6b1e-2a98-449e-8bd7-2d025c420a42=org.ovirt.engine.core.compat.KeyValuePairCompat@6132a21}, log id: 33e6b781 >2012-08-07 14:02:04,566 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) Server: RunQuery invoked! >2012-08-07 14:02:04,567 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:04,568 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:02:05,438 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-91) vdsManager::refreshVdsStats entered, vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3 >2012-08-07 14:02:05,439 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-91) START, GetStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@9d64ca20), log id: 7984b4ed >2012-08-07 14:02:05,444 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:05,445 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:05,445 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:05,446 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:05,446 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:05,447 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:05,447 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:05,448 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:05,448 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:05,449 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:05,453 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:05,453 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:05,489 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-91) FINISH, GetStatsVDSCommand, log id: 7984b4ed >2012-08-07 14:02:05,494 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-91) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@5875e564 >2012-08-07 14:02:05,495 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-91) vds::refreshVmList entered >2012-08-07 14:02:05,496 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-91) START, GetAllVmStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@9561f4e8), log id: 2427359b >2012-08-07 14:02:05,500 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:05,501 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:05,501 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:05,502 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:05,503 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:05,504 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:05,504 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:05,505 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:05,505 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:05,506 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:05,510 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:05,511 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:05,538 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-91) FINISH, GetAllVmStatsVDSCommand, return: {}, log id: 2427359b >2012-08-07 14:02:05,826 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) Server: RunQuery invoked! >2012-08-07 14:02:05,827 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:05,827 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) Server: RunQuery invoked! >2012-08-07 14:02:05,828 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:06,585 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-92) vds::refreshVmList entered >2012-08-07 14:02:06,590 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:06,591 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:06,591 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:06,592 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:06,593 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:06,593 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:06,594 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:06,594 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:06,595 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:06,595 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:06,596 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:06,596 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:07,638 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-93) vds::refreshVmList entered >2012-08-07 14:02:07,644 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:07,645 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:07,645 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:07,645 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:07,646 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:07,650 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:07,651 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:07,651 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:07,652 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:07,652 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:07,655 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:07,655 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:08,618 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-94) vds::refreshVmList entered >2012-08-07 14:02:08,624 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:08,624 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:08,624 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:08,625 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:08,625 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:08,626 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:08,626 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:08,627 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:08,627 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:08,628 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:08,631 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:08,631 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:09,568 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) Server: RunQuery invoked! >2012-08-07 14:02:09,569 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:09,570 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:02:09,690 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-95) vds::refreshVmList entered >2012-08-07 14:02:09,697 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:09,697 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:09,698 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:09,698 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:09,698 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:09,699 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:09,699 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:09,700 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:09,700 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:09,705 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:09,706 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:09,706 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:09,724 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-97) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 14:02:09,726 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-97) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 14:02:09,727 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-97) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 14:02:09,730 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-97) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 14:02:10,659 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-3) [5a6227d1] vds::refreshVmList entered >2012-08-07 14:02:10,663 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:10,663 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:10,664 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:10,664 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:10,665 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:10,665 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:10,666 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:10,666 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:10,667 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:10,667 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:10,668 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:10,668 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:10,822 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) Server: RunQuery invoked! >2012-08-07 14:02:10,822 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:10,826 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) Server: RunQuery invoked! >2012-08-07 14:02:10,827 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:11,742 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-4) vds::refreshVmList entered >2012-08-07 14:02:11,749 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:11,750 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:11,750 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:11,751 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:11,752 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:11,757 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:11,757 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:11,762 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:11,763 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:11,763 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:11,771 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:11,772 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:12,536 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-5) START, SpmStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f), log id: 2191d88b >2012-08-07 14:02:12,546 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:12,546 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:12,547 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:12,547 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:12,549 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:12,550 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:12,550 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:12,551 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:12,554 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:12,554 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:12,554 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:12,555 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:12,591 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-5) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@6e1f9ee4, log id: 2191d88b >2012-08-07 14:02:12,593 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-5) START, GetStoragePoolInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 3e58d895 >2012-08-07 14:02:12,601 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:12,602 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:12,602 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:12,603 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:12,603 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:12,604 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:12,604 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:12,605 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:12,605 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:12,606 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:12,610 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:12,611 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:12,654 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-5) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@2e0e93d0, log id: 3e58d895 >2012-08-07 14:02:12,691 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-6) vds::refreshVmList entered >2012-08-07 14:02:12,698 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:12,699 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:12,699 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:12,700 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:12,700 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:12,701 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:12,701 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:12,704 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:12,705 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:12,705 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:12,706 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:12,706 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:13,075 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-7) START, SpmStatusVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23), log id: 404fafa3 >2012-08-07 14:02:13,080 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:13,080 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:13,081 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:13,081 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:13,082 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:13,082 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:13,083 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:13,083 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:13,087 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:13,088 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:13,088 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:13,089 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:13,113 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-7) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2f941751, log id: 404fafa3 >2012-08-07 14:02:13,115 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-7) START, GetStoragePoolInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 2b7b05c9 >2012-08-07 14:02:13,119 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:13,119 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:13,120 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:13,120 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:13,120 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:13,121 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:13,121 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:13,122 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:13,122 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:13,123 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:13,123 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:13,124 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:13,154 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-7) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@5d2d4c1, log id: 2b7b05c9 >2012-08-07 14:02:13,817 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-8) vds::refreshVmList entered >2012-08-07 14:02:13,821 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:13,822 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:13,822 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:13,822 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:13,823 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:13,823 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:13,824 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:13,824 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:13,825 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:13,827 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:13,828 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:13,828 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:14,569 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-4) Server: RunQuery invoked! >2012-08-07 14:02:14,569 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-4) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:14,570 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:02:14,739 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-9) vdsManager::refreshVdsStats entered, vds = 4196a566-dee6-11e1-b66e-c35c5273fee7 : purple-vds2 >2012-08-07 14:02:14,740 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-9) START, GetStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@390a1b65), log id: 6e6c704 >2012-08-07 14:02:14,744 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:14,744 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:14,745 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:14,745 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:14,746 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:14,746 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:14,747 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:14,747 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:14,747 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:14,748 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:14,748 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:14,749 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:14,772 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-9) FINISH, GetStatsVDSCommand, log id: 6e6c704 >2012-08-07 14:02:14,774 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-9) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@5083416b >2012-08-07 14:02:14,774 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-9) vds::refreshVmList entered >2012-08-07 14:02:14,775 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-9) START, GetAllVmStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@82f4acb), log id: 593c0118 >2012-08-07 14:02:14,779 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:14,779 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:14,780 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:14,780 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:14,780 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:14,781 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:14,781 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:14,782 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:14,782 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:14,783 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:14,783 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:14,784 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:14,864 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-9) FINISH, GetAllVmStatsVDSCommand, return: {6c1fcddf-86d6-4533-905b-abb11b775f5b=org.ovirt.engine.core.compat.KeyValuePairCompat@f513df13, 2842672f-6230-434f-8232-e88e71560092=org.ovirt.engine.core.compat.KeyValuePairCompat@9542ec50, e5a192f1-3f9d-48e1-a817-28f72815c646=org.ovirt.engine.core.compat.KeyValuePairCompat@652aa7b1, 8738bb81-c73e-4a41-a24a-c4c49491c536=org.ovirt.engine.core.compat.KeyValuePairCompat@f22acf8b, 6a729fb0-47fe-4eba-9ba3-2b939eee2b19=org.ovirt.engine.core.compat.KeyValuePairCompat@a87ef452, ba81adbe-b311-4aef-b6c1-5f84f0f3c94d=org.ovirt.engine.core.compat.KeyValuePairCompat@41f02689, 54b872c6-cefc-4a19-b48e-9bc1a09285f9=org.ovirt.engine.core.compat.KeyValuePairCompat@3b587dab, 9dbe6b1e-2a98-449e-8bd7-2d025c420a42=org.ovirt.engine.core.compat.KeyValuePairCompat@784f9421}, log id: 593c0118 >2012-08-07 14:02:15,822 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-16) Server: RunQuery invoked! >2012-08-07 14:02:15,822 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-16) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:15,823 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-17) Server: RunQuery invoked! >2012-08-07 14:02:15,824 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-17) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:15,854 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-10) vdsManager::refreshVdsStats entered, vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3 >2012-08-07 14:02:15,857 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-10) START, GetStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@7fa7a30b), log id: 61b8d397 >2012-08-07 14:02:15,863 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:15,864 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:15,864 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:15,865 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:15,865 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:15,866 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:15,866 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:15,866 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:15,867 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:15,871 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:15,872 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:15,872 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:15,918 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-10) FINISH, GetStatsVDSCommand, log id: 61b8d397 >2012-08-07 14:02:15,919 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-10) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@56eef0a5 >2012-08-07 14:02:15,920 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-10) vds::refreshVmList entered >2012-08-07 14:02:15,921 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-10) START, GetAllVmStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@4952343c), log id: 60f90d39 >2012-08-07 14:02:15,929 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:15,929 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:15,930 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:15,930 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:15,931 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:15,931 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:15,932 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:15,932 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:15,933 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:15,933 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:15,939 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) Server: RunQuery invoked! >2012-08-07 14:02:15,944 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:15,949 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:15,950 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:15,990 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-10) FINISH, GetAllVmStatsVDSCommand, return: {}, log id: 60f90d39 >2012-08-07 14:02:17,492 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-12) vds::refreshVmList entered >2012-08-07 14:02:17,495 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:17,496 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:17,496 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:17,497 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:17,497 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:17,498 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:17,498 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:17,499 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:17,499 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:17,500 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:17,500 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:17,501 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:18,041 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-17) vds::refreshVmList entered >2012-08-07 14:02:18,046 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:18,046 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:18,046 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:18,047 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:18,047 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:18,048 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:18,048 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:18,049 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:18,053 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:18,053 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:18,053 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:18,054 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:19,551 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-13) vds::refreshVmList entered >2012-08-07 14:02:19,555 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:19,555 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:19,556 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:19,556 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:19,557 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:19,557 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:19,557 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:19,558 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:19,558 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:19,559 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:19,559 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:19,560 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:19,567 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) Server: RunQuery invoked! >2012-08-07 14:02:19,568 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:19,569 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:02:20,093 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-16) [52278849] vds::refreshVmList entered >2012-08-07 14:02:20,098 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:20,098 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:20,099 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:20,099 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:20,100 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:20,100 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:20,101 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:20,101 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:20,102 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:20,102 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:20,102 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:20,103 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:20,823 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) Server: RunQuery invoked! >2012-08-07 14:02:20,824 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:20,825 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) Server: RunQuery invoked! >2012-08-07 14:02:20,826 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:20,935 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) Server: RunQuery invoked! >2012-08-07 14:02:20,936 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:21,600 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-21) vds::refreshVmList entered >2012-08-07 14:02:21,607 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:21,608 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:21,608 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:21,609 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:21,609 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:21,609 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:21,610 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:21,611 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:21,611 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:21,611 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:21,612 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:21,612 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:22,128 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-18) vds::refreshVmList entered >2012-08-07 14:02:22,132 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:22,132 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:22,132 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:22,133 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:22,133 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:22,134 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:22,136 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:22,137 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:22,137 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:22,138 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:22,138 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:22,138 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:22,743 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-22) START, SpmStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f), log id: 316a4198 >2012-08-07 14:02:22,748 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:22,748 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:22,749 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:22,749 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:22,749 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:22,750 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:22,753 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:22,754 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:22,754 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:22,755 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:22,755 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:22,756 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:22,777 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-22) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@36f87b80, log id: 316a4198 >2012-08-07 14:02:22,781 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-22) START, GetStoragePoolInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 15449b8e >2012-08-07 14:02:22,787 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:22,787 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:22,788 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:22,788 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:22,789 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:22,789 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:22,790 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:22,795 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:22,796 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:22,796 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:22,797 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:22,797 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:22,850 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-22) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@2e0e93d0, log id: 15449b8e >2012-08-07 14:02:23,260 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-23) START, SpmStatusVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23), log id: 504808a4 >2012-08-07 14:02:23,265 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:23,266 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:23,266 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:23,267 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:23,267 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:23,268 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:23,268 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:23,269 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:23,269 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:23,270 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:23,270 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:23,271 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:23,290 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-23) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@292f7029, log id: 504808a4 >2012-08-07 14:02:23,292 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-23) START, GetStoragePoolInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 24eb128b >2012-08-07 14:02:23,296 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:23,297 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:23,297 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:23,297 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:23,298 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:23,298 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:23,299 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:23,299 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:23,300 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:23,300 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:23,300 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:23,301 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:23,325 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-23) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@5d2d4c1, log id: 24eb128b >2012-08-07 14:02:23,652 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-24) vds::refreshVmList entered >2012-08-07 14:02:23,656 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:23,656 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:23,656 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:23,657 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:23,657 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:23,658 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:23,658 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:23,659 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:23,659 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:23,660 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:23,660 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:23,660 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:24,178 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-25) vds::refreshVmList entered >2012-08-07 14:02:24,188 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:24,188 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:24,188 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:24,189 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:24,189 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:24,190 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:24,190 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:24,191 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:24,191 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:24,192 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:24,192 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:24,193 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:24,590 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) Server: RunQuery invoked! >2012-08-07 14:02:24,591 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:24,591 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-12) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:02:25,682 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-26) vdsManager::refreshVdsStats entered, vds = 4196a566-dee6-11e1-b66e-c35c5273fee7 : purple-vds2 >2012-08-07 14:02:25,683 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-26) START, GetStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@6b5fb9a4), log id: 4d48113a >2012-08-07 14:02:25,690 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:25,690 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:25,691 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:25,691 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:25,691 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:25,692 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:25,697 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:25,697 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:25,697 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:25,698 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:25,702 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:25,702 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:25,729 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-26) FINISH, GetStatsVDSCommand, log id: 4d48113a >2012-08-07 14:02:25,731 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-26) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@642170cd >2012-08-07 14:02:25,732 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-26) vds::refreshVmList entered >2012-08-07 14:02:25,732 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-26) START, GetAllVmStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@fea4472d), log id: 4f74d616 >2012-08-07 14:02:25,736 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:25,736 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:25,737 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:25,737 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:25,738 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:25,738 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:25,739 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:25,739 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:25,739 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:25,740 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:25,740 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:25,741 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:25,816 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) Server: RunQuery invoked! >2012-08-07 14:02:25,817 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:25,818 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) Server: RunQuery invoked! >2012-08-07 14:02:25,819 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:25,861 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-26) FINISH, GetAllVmStatsVDSCommand, return: {6c1fcddf-86d6-4533-905b-abb11b775f5b=org.ovirt.engine.core.compat.KeyValuePairCompat@67504913, 2842672f-6230-434f-8232-e88e71560092=org.ovirt.engine.core.compat.KeyValuePairCompat@77f5650, e5a192f1-3f9d-48e1-a817-28f72815c646=org.ovirt.engine.core.compat.KeyValuePairCompat@d76711b1, 8738bb81-c73e-4a41-a24a-c4c49491c536=org.ovirt.engine.core.compat.KeyValuePairCompat@6467398b, 6a729fb0-47fe-4eba-9ba3-2b939eee2b19=org.ovirt.engine.core.compat.KeyValuePairCompat@1abb5e52, ba81adbe-b311-4aef-b6c1-5f84f0f3c94d=org.ovirt.engine.core.compat.KeyValuePairCompat@b42c9089, 54b872c6-cefc-4a19-b48e-9bc1a09285f9=org.ovirt.engine.core.compat.KeyValuePairCompat@ad94e7ab, 9dbe6b1e-2a98-449e-8bd7-2d025c420a42=org.ovirt.engine.core.compat.KeyValuePairCompat@ea8bfe21}, log id: 4f74d616 >2012-08-07 14:02:26,219 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-27) vdsManager::refreshVdsStats entered, vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3 >2012-08-07 14:02:26,221 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-27) START, GetStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@2efdc50a), log id: 394620eb >2012-08-07 14:02:26,226 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:26,226 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:26,227 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:26,228 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:26,228 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:26,229 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:26,229 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:26,230 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:26,230 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:26,230 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:26,231 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:26,231 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:26,262 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-27) FINISH, GetStatsVDSCommand, log id: 394620eb >2012-08-07 14:02:26,264 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-27) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@355eb0e7 >2012-08-07 14:02:26,266 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-27) vds::refreshVmList entered >2012-08-07 14:02:26,267 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-27) START, GetAllVmStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@37059e77), log id: 5bb02910 >2012-08-07 14:02:26,273 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:26,274 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:26,275 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:26,276 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:26,276 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:26,277 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:26,278 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:26,282 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:26,283 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:26,284 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:26,284 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:26,284 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:26,307 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-27) FINISH, GetAllVmStatsVDSCommand, return: {}, log id: 5bb02910 >2012-08-07 14:02:28,078 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-28) vds::refreshVmList entered >2012-08-07 14:02:28,085 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:28,085 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:28,086 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:28,091 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:28,091 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:28,092 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:28,092 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:28,093 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:28,093 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:28,094 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:28,094 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:28,094 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:28,367 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-30) vds::refreshVmList entered >2012-08-07 14:02:28,373 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:28,374 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:28,375 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:28,375 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:28,376 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:28,376 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:28,377 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:28,377 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:28,378 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:28,378 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:28,379 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:28,380 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:29,566 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) Server: RunQuery invoked! >2012-08-07 14:02:29,566 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:29,567 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:02:30,139 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-35) vds::refreshVmList entered >2012-08-07 14:02:30,143 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:30,143 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:30,144 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:30,144 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:30,145 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:30,145 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:30,145 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:30,146 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:30,146 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:30,147 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:30,148 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:30,148 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:30,401 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-36) vds::refreshVmList entered >2012-08-07 14:02:30,410 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:30,411 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:30,411 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:30,412 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:30,412 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:30,413 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:30,416 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:30,417 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:30,417 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:30,418 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:30,418 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:30,421 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:30,816 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) Server: RunQuery invoked! >2012-08-07 14:02:30,817 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:30,817 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) Server: RunQuery invoked! >2012-08-07 14:02:30,818 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:32,171 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-37) vds::refreshVmList entered >2012-08-07 14:02:32,177 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:32,177 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:32,178 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:32,178 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:32,179 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:32,179 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:32,180 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:32,180 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:32,181 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:32,181 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:32,182 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:32,187 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:32,450 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-38) vds::refreshVmList entered >2012-08-07 14:02:32,456 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:32,456 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:32,457 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:32,457 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:32,458 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:32,458 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:32,458 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:32,459 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:32,459 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:32,460 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:32,460 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:32,461 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:32,933 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-39) START, SpmStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f), log id: 2a2a0347 >2012-08-07 14:02:32,939 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:32,940 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:32,940 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:32,941 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:32,941 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:32,942 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:32,942 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:32,942 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:32,943 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:32,943 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:32,944 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:32,944 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:32,963 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-39) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2c3d3ff1, log id: 2a2a0347 >2012-08-07 14:02:32,966 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-39) START, GetStoragePoolInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 4bb1d54 >2012-08-07 14:02:32,971 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:32,971 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:32,971 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:32,972 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:32,972 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:32,973 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:32,975 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:32,975 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:32,976 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:32,976 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:32,977 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:32,977 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:33,011 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-39) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@2e0e93d0, log id: 4bb1d54 >2012-08-07 14:02:33,407 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-40) START, SpmStatusVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23), log id: 5cebd143 >2012-08-07 14:02:33,412 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:33,412 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:33,413 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:33,413 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:33,414 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:33,414 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:33,415 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:33,415 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:33,416 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:33,417 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:33,417 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:33,418 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:33,468 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-40) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3198995d, log id: 5cebd143 >2012-08-07 14:02:33,472 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-40) START, GetStoragePoolInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = true, compatabilityVersion = null), log id: db0c21 >2012-08-07 14:02:33,476 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:33,476 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:33,477 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:33,477 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:33,478 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:33,478 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:33,479 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:33,479 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:33,480 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:33,480 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:33,481 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:33,481 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:33,509 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-40) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@5d2d4c1, log id: db0c21 >2012-08-07 14:02:34,226 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-41) vds::refreshVmList entered >2012-08-07 14:02:34,229 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:34,230 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:34,230 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:34,230 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:34,231 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:34,231 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:34,232 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:34,232 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:34,233 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:34,235 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:34,235 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:34,236 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:34,485 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-42) vds::refreshVmList entered >2012-08-07 14:02:34,492 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:34,492 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:34,493 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:34,493 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:34,494 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:34,494 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:34,495 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:34,495 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:34,496 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:34,499 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:34,500 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:34,500 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:34,586 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) Server: RunQuery invoked! >2012-08-07 14:02:34,587 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:34,588 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:02:35,815 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) Server: RunQuery invoked! >2012-08-07 14:02:35,815 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:35,819 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) Server: RunQuery invoked! >2012-08-07 14:02:35,819 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:36,090 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) Server: RunQuery invoked! >2012-08-07 14:02:36,091 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) IP [10.35.3.239], Session ID [jmPBXs9cXUOonFcWXtMMzEUr.undefined] >2012-08-07 14:02:36,091 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) Server: RunQuery invoked! >2012-08-07 14:02:36,092 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) IP [10.35.3.239], Session ID [jmPBXs9cXUOonFcWXtMMzEUr.undefined] >2012-08-07 14:02:36,258 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-43) vdsManager::refreshVdsStats entered, vds = 4196a566-dee6-11e1-b66e-c35c5273fee7 : purple-vds2 >2012-08-07 14:02:36,259 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-43) START, GetStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@390a1b65), log id: 41581b06 >2012-08-07 14:02:36,267 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:36,267 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:36,268 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:36,268 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:36,269 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:36,271 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:36,271 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:36,272 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:36,272 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:36,273 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:36,273 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:36,274 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:36,298 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-43) FINISH, GetStatsVDSCommand, log id: 41581b06 >2012-08-07 14:02:36,301 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-43) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@2f8518b1 >2012-08-07 14:02:36,301 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-43) vds::refreshVmList entered >2012-08-07 14:02:36,302 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-43) START, GetAllVmStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@ca3e3c31), log id: 4b1824d6 >2012-08-07 14:02:36,306 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:36,306 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:36,307 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:36,307 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:36,308 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:36,308 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:36,309 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:36,309 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:36,309 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:36,310 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:36,310 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:36,311 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:36,363 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-43) FINISH, GetAllVmStatsVDSCommand, return: {6c1fcddf-86d6-4533-905b-abb11b775f5b=org.ovirt.engine.core.compat.KeyValuePairCompat@d98cb313, 2842672f-6230-434f-8232-e88e71560092=org.ovirt.engine.core.compat.KeyValuePairCompat@e3b64250, e5a192f1-3f9d-48e1-a817-28f72815c646=org.ovirt.engine.core.compat.KeyValuePairCompat@75e9b0de, 8738bb81-c73e-4a41-a24a-c4c49491c536=org.ovirt.engine.core.compat.KeyValuePairCompat@d6a3a38b, 6a729fb0-47fe-4eba-9ba3-2b939eee2b19=org.ovirt.engine.core.compat.KeyValuePairCompat@8cf7c852, ba81adbe-b311-4aef-b6c1-5f84f0f3c94d=org.ovirt.engine.core.compat.KeyValuePairCompat@2668fa89, 54b872c6-cefc-4a19-b48e-9bc1a09285f9=org.ovirt.engine.core.compat.KeyValuePairCompat@89cbd3ab, 9dbe6b1e-2a98-449e-8bd7-2d025c420a42=org.ovirt.engine.core.compat.KeyValuePairCompat@c6c2ea21}, log id: 4b1824d6 >2012-08-07 14:02:36,525 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-44) vdsManager::refreshVdsStats entered, vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3 >2012-08-07 14:02:36,530 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-44) START, GetStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@7fa7a30b), log id: 33cebb68 >2012-08-07 14:02:36,536 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:36,536 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:36,537 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:36,537 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:36,538 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:36,538 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:36,539 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:36,539 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:36,540 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:36,544 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:36,545 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:36,545 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:36,600 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-44) FINISH, GetStatsVDSCommand, log id: 33cebb68 >2012-08-07 14:02:36,602 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-44) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@13e7e7bc >2012-08-07 14:02:36,602 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-44) vds::refreshVmList entered >2012-08-07 14:02:36,603 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-44) START, GetAllVmStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@8a23d027), log id: 5e1ef1d9 >2012-08-07 14:02:36,607 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:36,607 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:36,608 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:36,608 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:36,609 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:36,609 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:36,610 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:36,610 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:36,611 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:36,611 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:36,611 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:36,612 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:36,638 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-44) FINISH, GetAllVmStatsVDSCommand, return: {}, log id: 5e1ef1d9 >2012-08-07 14:02:38,660 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-45) vds::refreshVmList entered >2012-08-07 14:02:38,665 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:38,666 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:38,666 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:38,666 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:38,667 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:38,667 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:38,668 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:38,668 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:38,673 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:38,673 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:38,674 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:38,674 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:38,758 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-46) vds::refreshVmList entered >2012-08-07 14:02:38,767 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:38,768 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:38,768 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:38,769 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:38,769 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:38,770 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:38,770 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:38,771 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:38,771 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:38,775 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:38,775 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:38,775 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:39,575 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) Server: RunQuery invoked! >2012-08-07 14:02:39,576 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:39,576 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-20) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:02:40,700 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-53) vds::refreshVmList entered >2012-08-07 14:02:40,711 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:40,711 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:40,712 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:40,712 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:40,713 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:40,713 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:40,714 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:40,714 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:40,714 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:40,715 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:40,719 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:40,720 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:40,798 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-55) vds::refreshVmList entered >2012-08-07 14:02:40,801 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:40,802 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:40,802 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:40,803 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:40,803 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:40,804 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:40,804 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:40,804 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:40,805 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:40,805 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:40,806 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:40,806 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:40,817 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-4) Server: RunQuery invoked! >2012-08-07 14:02:40,819 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-4) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:40,821 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-16) Server: RunQuery invoked! >2012-08-07 14:02:40,821 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-16) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:42,746 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-54) vds::refreshVmList entered >2012-08-07 14:02:42,750 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:42,751 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:42,751 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:42,752 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:42,752 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:42,753 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:42,754 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:42,754 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:42,755 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:42,755 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:42,756 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:42,756 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:42,838 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-56) vds::refreshVmList entered >2012-08-07 14:02:42,843 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:42,843 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:42,844 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:42,844 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:42,844 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:42,845 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:42,845 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:42,846 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:42,846 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:42,847 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:42,847 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:42,847 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:43,073 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-57) START, SpmStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f), log id: 490bd0e8 >2012-08-07 14:02:43,077 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:43,077 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:43,078 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:43,078 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:43,079 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:43,081 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:43,082 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:43,082 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:43,083 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:43,083 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:43,083 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:43,084 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:43,103 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-57) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@26c054cf, log id: 490bd0e8 >2012-08-07 14:02:43,105 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-57) START, GetStoragePoolInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 4da8940a >2012-08-07 14:02:43,109 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:43,109 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:43,109 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:43,110 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:43,110 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:43,111 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:43,111 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:43,111 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:43,112 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:43,112 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:43,113 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:43,113 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:43,138 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-57) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@2e0e93d0, log id: 4da8940a >2012-08-07 14:02:43,671 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-58) START, SpmStatusVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23), log id: 645e8f18 >2012-08-07 14:02:43,678 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:43,678 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:43,679 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:43,679 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:43,679 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:43,680 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:43,680 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:43,681 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:43,682 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:43,684 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:43,684 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:43,685 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:43,704 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-58) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7c04a422, log id: 645e8f18 >2012-08-07 14:02:43,708 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-58) START, GetStoragePoolInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 9600a4d >2012-08-07 14:02:43,714 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:43,714 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:43,714 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:43,715 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:43,715 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:43,716 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:43,716 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:43,717 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:43,717 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:43,717 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:43,718 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:43,720 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:43,743 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-58) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@5d2d4c1, log id: 9600a4d >2012-08-07 14:02:44,535 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-17) Server: RunQuery invoked! >2012-08-07 14:02:44,536 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-17) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:44,539 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:02:44,783 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-59) vds::refreshVmList entered >2012-08-07 14:02:44,787 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:44,788 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:44,788 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:44,789 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:44,789 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:44,790 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:44,790 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:44,791 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:44,791 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:44,792 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:44,792 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:44,793 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:44,878 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-60) vds::refreshVmList entered >2012-08-07 14:02:44,881 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:44,882 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:44,882 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:44,883 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:44,883 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:44,883 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:44,884 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:44,884 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:44,885 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:44,885 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:44,886 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:44,886 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:45,783 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) Server: RunQuery invoked! >2012-08-07 14:02:45,786 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:45,786 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) Server: RunQuery invoked! >2012-08-07 14:02:45,787 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:46,819 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-61) vdsManager::refreshVdsStats entered, vds = 4196a566-dee6-11e1-b66e-c35c5273fee7 : purple-vds2 >2012-08-07 14:02:46,820 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-61) START, GetStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@7afaddac), log id: 3d89e9f >2012-08-07 14:02:46,824 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:46,824 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:46,825 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:46,825 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:46,826 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:46,826 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:46,826 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:46,827 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:46,832 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:46,833 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:46,833 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:46,834 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:46,861 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-61) FINISH, GetStatsVDSCommand, log id: 3d89e9f >2012-08-07 14:02:46,871 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-61) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@3a0b5a58 >2012-08-07 14:02:46,872 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-61) vds::refreshVmList entered >2012-08-07 14:02:46,873 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-61) START, GetAllVmStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@24e33ecd), log id: 3f58652d >2012-08-07 14:02:46,882 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:46,882 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:46,883 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:46,883 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:46,883 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:46,884 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:46,884 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:46,885 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:46,885 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:46,886 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:46,888 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:46,888 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:46,915 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-62) vdsManager::refreshVdsStats entered, vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3 >2012-08-07 14:02:46,916 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-62) START, GetStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@7fa7a30b), log id: 7fb7d028 >2012-08-07 14:02:46,928 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:46,929 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:46,929 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:46,930 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:46,930 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:46,934 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:46,935 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:46,935 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:46,936 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:46,938 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:46,939 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:46,939 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:46,986 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-61) FINISH, GetAllVmStatsVDSCommand, return: {6c1fcddf-86d6-4533-905b-abb11b775f5b=org.ovirt.engine.core.compat.KeyValuePairCompat@b5c39f13, 2842672f-6230-434f-8232-e88e71560092=org.ovirt.engine.core.compat.KeyValuePairCompat@55f2ac50, e5a192f1-3f9d-48e1-a817-28f72815c646=org.ovirt.engine.core.compat.KeyValuePairCompat@52209cde, 8738bb81-c73e-4a41-a24a-c4c49491c536=org.ovirt.engine.core.compat.KeyValuePairCompat@48e00d8b, 6a729fb0-47fe-4eba-9ba3-2b939eee2b19=org.ovirt.engine.core.compat.KeyValuePairCompat@692eb452, ba81adbe-b311-4aef-b6c1-5f84f0f3c94d=org.ovirt.engine.core.compat.KeyValuePairCompat@ad0c8a24, 54b872c6-cefc-4a19-b48e-9bc1a09285f9=org.ovirt.engine.core.compat.KeyValuePairCompat@fc083dab, 9dbe6b1e-2a98-449e-8bd7-2d025c420a42=org.ovirt.engine.core.compat.KeyValuePairCompat@cb91ef4}, log id: 3f58652d >2012-08-07 14:02:47,000 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-62) FINISH, GetStatsVDSCommand, log id: 7fb7d028 >2012-08-07 14:02:47,007 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-62) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@4237eaff >2012-08-07 14:02:47,008 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-62) vds::refreshVmList entered >2012-08-07 14:02:47,009 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-62) START, GetAllVmStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@9283c63b), log id: 65252d4f >2012-08-07 14:02:47,018 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:47,018 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:47,019 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:47,019 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:47,020 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:47,020 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:47,021 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:47,023 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:47,023 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:47,024 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:47,024 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:47,025 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:47,064 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-62) FINISH, GetAllVmStatsVDSCommand, return: {}, log id: 65252d4f >2012-08-07 14:02:49,192 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-63) vds::refreshVmList entered >2012-08-07 14:02:49,197 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:49,197 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:49,197 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:49,198 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:49,198 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:49,199 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:49,199 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:49,200 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:49,200 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:49,201 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:49,204 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:49,204 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:49,228 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-64) vds::refreshVmList entered >2012-08-07 14:02:49,238 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:49,238 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:49,238 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:49,239 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:49,239 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:49,240 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:49,240 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:49,240 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:49,245 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:49,246 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:49,246 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:49,247 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:49,567 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) Server: RunQuery invoked! >2012-08-07 14:02:49,568 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:49,569 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-5) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:02:50,821 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) Server: RunQuery invoked! >2012-08-07 14:02:50,822 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:50,823 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) Server: RunQuery invoked! >2012-08-07 14:02:50,828 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:51,256 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-70) vds::refreshVmList entered >2012-08-07 14:02:51,261 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:51,261 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:51,262 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:51,262 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:51,262 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:51,263 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:51,263 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:51,264 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:51,264 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:51,264 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:51,265 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:51,265 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:51,273 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-71) vds::refreshVmList entered >2012-08-07 14:02:51,282 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:51,282 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:51,282 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:51,283 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:51,283 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:51,284 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:51,284 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:51,285 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:51,289 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:51,290 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:51,290 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:51,291 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:53,204 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-72) START, SpmStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f), log id: 2ba5722d >2012-08-07 14:02:53,208 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:53,209 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:53,209 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:53,209 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:53,210 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:53,210 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:53,211 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:53,211 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:53,212 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:53,212 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:53,213 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:53,213 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:53,235 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-72) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7aeafebd, log id: 2ba5722d >2012-08-07 14:02:53,237 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-72) START, GetStoragePoolInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 547ffe6a >2012-08-07 14:02:53,245 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:53,246 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:53,246 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:53,247 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:53,247 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:53,247 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:53,248 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:53,248 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:53,249 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:53,249 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:53,250 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:53,250 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:53,280 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-72) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@2e0e93d0, log id: 547ffe6a >2012-08-07 14:02:53,324 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-73) vds::refreshVmList entered >2012-08-07 14:02:53,330 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:53,330 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:53,331 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:53,333 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:53,334 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:53,334 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:53,335 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:53,339 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-74) vds::refreshVmList entered >2012-08-07 14:02:53,340 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:53,343 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:53,345 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:53,345 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:53,346 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:53,346 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:53,347 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:53,347 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:53,348 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:53,348 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:53,353 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:53,354 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:53,354 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:53,348 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:53,355 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:53,356 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:53,356 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:53,893 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-75) START, SpmStatusVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23), log id: 36dff9a5 >2012-08-07 14:02:53,898 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:53,898 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:53,899 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:53,899 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:53,900 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:53,900 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:53,901 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:53,902 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:53,902 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:53,902 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:53,903 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:53,903 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:53,926 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-75) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2a7edbc8, log id: 36dff9a5 >2012-08-07 14:02:53,928 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-75) START, GetStoragePoolInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 330305d3 >2012-08-07 14:02:53,932 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:53,933 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:53,933 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:53,933 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:53,934 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:53,934 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:53,935 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:53,935 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:53,936 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:53,936 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:53,937 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:53,937 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:53,980 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-75) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@5d2d4c1, log id: 330305d3 >2012-08-07 14:02:54,583 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) Server: RunQuery invoked! >2012-08-07 14:02:54,585 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:54,586 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-12) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:02:55,405 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) vds::refreshVmList entered >2012-08-07 14:02:55,409 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:55,410 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:55,410 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:55,411 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:55,411 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:55,416 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-77) vds::refreshVmList entered >2012-08-07 14:02:55,418 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:55,419 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:55,419 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:55,420 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:55,420 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:55,421 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:55,421 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:55,422 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:55,422 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:55,423 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:55,423 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:55,423 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:55,424 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:55,424 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:55,425 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:55,425 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:55,426 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:55,426 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:55,430 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:55,824 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) Server: RunQuery invoked! >2012-08-07 14:02:55,825 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:55,831 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) Server: RunQuery invoked! >2012-08-07 14:02:55,832 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:57,466 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-78) vdsManager::refreshVdsStats entered, vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3 >2012-08-07 14:02:57,467 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-78) START, GetStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@7fa7a30b), log id: 35d649f0 >2012-08-07 14:02:57,471 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-79) vdsManager::refreshVdsStats entered, vds = 4196a566-dee6-11e1-b66e-c35c5273fee7 : purple-vds2 >2012-08-07 14:02:57,471 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-79) START, GetStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@164fa12e), log id: 94adc5f >2012-08-07 14:02:57,482 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:57,483 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:57,484 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:57,484 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:57,485 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:57,485 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:57,486 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:57,486 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:57,489 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:57,492 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:57,493 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:57,493 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:57,494 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:57,494 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:57,495 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:57,495 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:57,496 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:57,496 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:57,497 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:57,495 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:57,501 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:57,502 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:57,502 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:57,505 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:57,560 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-79) FINISH, GetStatsVDSCommand, log id: 94adc5f >2012-08-07 14:02:57,562 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-79) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@65b18bc7 >2012-08-07 14:02:57,562 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-79) vds::refreshVmList entered >2012-08-07 14:02:57,563 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-79) START, GetAllVmStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@f2ba2be3), log id: 6b4fe9f9 >2012-08-07 14:02:57,565 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-78) FINISH, GetStatsVDSCommand, log id: 35d649f0 >2012-08-07 14:02:57,571 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-78) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@31a9c9b >2012-08-07 14:02:57,571 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-78) vds::refreshVmList entered >2012-08-07 14:02:57,576 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-78) START, GetAllVmStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@f5b6053b), log id: 481f85b4 >2012-08-07 14:02:57,577 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:57,578 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:57,579 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:57,580 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:57,583 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:02:57,585 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:57,585 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:57,586 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:57,586 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:57,587 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:57,587 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:02:57,588 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:57,588 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:57,590 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:57,590 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:57,591 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:57,591 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:57,592 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:57,592 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:57,592 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:57,593 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:57,593 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:57,592 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:57,598 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:57,622 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-78) FINISH, GetAllVmStatsVDSCommand, return: {}, log id: 481f85b4 >2012-08-07 14:02:57,688 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-79) FINISH, GetAllVmStatsVDSCommand, return: {6c1fcddf-86d6-4533-905b-abb11b775f5b=org.ovirt.engine.core.compat.KeyValuePairCompat@28000913, 2842672f-6230-434f-8232-e88e71560092=org.ovirt.engine.core.compat.KeyValuePairCompat@c82f1650, e5a192f1-3f9d-48e1-a817-28f72815c646=org.ovirt.engine.core.compat.KeyValuePairCompat@c45d06de, 8738bb81-c73e-4a41-a24a-c4c49491c536=org.ovirt.engine.core.compat.KeyValuePairCompat@2516f98b, 6a729fb0-47fe-4eba-9ba3-2b939eee2b19=org.ovirt.engine.core.compat.KeyValuePairCompat@cfc33dc6, ba81adbe-b311-4aef-b6c1-5f84f0f3c94d=org.ovirt.engine.core.compat.KeyValuePairCompat@74dc5089, 54b872c6-cefc-4a19-b48e-9bc1a09285f9=org.ovirt.engine.core.compat.KeyValuePairCompat@cc97491f, 9dbe6b1e-2a98-449e-8bd7-2d025c420a42=org.ovirt.engine.core.compat.KeyValuePairCompat@ab3bbe21}, log id: 6b4fe9f9 >2012-08-07 14:02:59,588 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) Server: RunQuery invoked! >2012-08-07 14:02:59,590 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:02:59,590 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:02:59,710 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-80) vds::refreshVmList entered >2012-08-07 14:02:59,714 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:59,715 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:59,715 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:59,716 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:02:59,716 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:02:59,717 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:59,717 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:59,718 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:59,718 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:59,719 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:59,719 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:59,720 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:59,913 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-86) vds::refreshVmList entered >2012-08-07 14:02:59,918 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:02:59,918 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:02:59,918 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:59,919 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:02:59,919 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:02:59,920 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:59,923 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:02:59,924 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:02:59,924 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:02:59,925 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:02:59,925 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:02:59,925 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:00,820 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) Server: RunQuery invoked! >2012-08-07 14:03:00,821 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:00,825 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) Server: RunQuery invoked! >2012-08-07 14:03:00,825 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:01,741 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-87) vds::refreshVmList entered >2012-08-07 14:03:01,745 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:01,746 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:01,746 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:01,747 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:01,747 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:01,747 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:01,748 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:01,751 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:01,752 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:01,752 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:01,752 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:01,753 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:01,952 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-88) vds::refreshVmList entered >2012-08-07 14:03:01,956 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:01,956 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:01,957 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:01,957 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:01,957 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:01,958 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:01,958 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:01,959 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:01,959 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:01,960 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:01,960 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:01,961 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:03,363 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-89) START, SpmStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f), log id: 5d3188dd >2012-08-07 14:03:03,367 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:03,367 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:03,368 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:03,368 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:03,369 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:03,369 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:03,370 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:03,370 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:03,370 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:03,371 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:03,371 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:03,372 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:03,393 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-89) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5f1094f7, log id: 5d3188dd >2012-08-07 14:03:03,397 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-89) START, GetStoragePoolInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 53f0fe81 >2012-08-07 14:03:03,404 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:03,404 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:03,405 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:03,405 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:03,406 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:03,407 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:03,407 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:03,410 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:03,410 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:03,411 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:03,411 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:03,412 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:03,437 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-89) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@2e0e93d0, log id: 53f0fe81 >2012-08-07 14:03:03,792 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-90) vds::refreshVmList entered >2012-08-07 14:03:03,796 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:03,797 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:03,797 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:03,797 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:03,798 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:03,798 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:03,800 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:03,800 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:03,801 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:03,801 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:03,802 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:03,802 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:03,982 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-91) vds::refreshVmList entered >2012-08-07 14:03:03,985 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:03,986 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:03,986 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:03,986 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:03,987 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:03,987 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:03,988 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:03,988 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:03,989 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:03,989 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:03,989 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:03,990 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:04,066 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-92) START, SpmStatusVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23), log id: e50fd19 >2012-08-07 14:03:04,070 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:04,070 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:04,071 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:04,071 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:04,072 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:04,072 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:04,073 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:04,073 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:04,073 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:04,074 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:04,074 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:04,075 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:04,095 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-92) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@67187ba6, log id: e50fd19 >2012-08-07 14:03:04,100 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-92) START, GetStoragePoolInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 4776fbae >2012-08-07 14:03:04,103 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:04,104 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:04,104 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:04,104 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:04,105 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:04,105 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:04,106 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:04,106 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:04,107 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:04,107 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:04,109 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:04,109 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:04,159 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-92) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@5d2d4c1, log id: 4776fbae >2012-08-07 14:03:04,569 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) Server: RunQuery invoked! >2012-08-07 14:03:04,569 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:04,570 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:03:05,822 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) Server: RunQuery invoked! >2012-08-07 14:03:05,822 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:05,826 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) Server: RunQuery invoked! >2012-08-07 14:03:05,826 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:05,834 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-93) vds::refreshVmList entered >2012-08-07 14:03:05,838 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:05,838 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:05,839 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:05,839 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:05,840 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:05,840 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:05,842 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:05,842 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:05,843 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:05,843 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:05,844 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:05,844 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:06,012 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-94) vds::refreshVmList entered >2012-08-07 14:03:06,018 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:06,019 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:06,019 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:06,020 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:06,020 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:06,021 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:06,021 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:06,022 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:06,022 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:06,023 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:06,023 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:06,023 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:07,868 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-96) vdsManager::refreshVdsStats entered, vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3 >2012-08-07 14:03:07,869 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-96) START, GetStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@2efdc50a), log id: 5a402120 >2012-08-07 14:03:07,873 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:07,874 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:07,874 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:07,874 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:07,875 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:07,875 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:07,876 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:07,876 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:07,877 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:07,877 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:07,878 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:07,878 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:07,902 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-96) FINISH, GetStatsVDSCommand, log id: 5a402120 >2012-08-07 14:03:07,903 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-96) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@225a9fc6 >2012-08-07 14:03:07,904 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-96) vds::refreshVmList entered >2012-08-07 14:03:07,905 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-96) START, GetAllVmStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@ce387b34), log id: 6baf91c8 >2012-08-07 14:03:07,911 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:07,911 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:07,912 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:07,912 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:07,913 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:07,913 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:07,914 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:07,917 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:07,918 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:07,918 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:07,919 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:07,919 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:07,966 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-96) FINISH, GetAllVmStatsVDSCommand, return: {}, log id: 6baf91c8 >2012-08-07 14:03:08,045 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-98) vdsManager::refreshVdsStats entered, vds = 4196a566-dee6-11e1-b66e-c35c5273fee7 : purple-vds2 >2012-08-07 14:03:08,046 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-98) START, GetStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@6b5fb9a4), log id: 3600b7ab >2012-08-07 14:03:08,051 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:08,052 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:08,052 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:08,053 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:08,053 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:08,054 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:08,057 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:08,058 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:08,058 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:08,059 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:08,059 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:08,059 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:08,095 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-98) FINISH, GetStatsVDSCommand, log id: 3600b7ab >2012-08-07 14:03:08,097 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-98) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@115d332f >2012-08-07 14:03:08,097 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-98) vds::refreshVmList entered >2012-08-07 14:03:08,098 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-98) START, GetAllVmStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@6fc9e528), log id: 7dcb5b90 >2012-08-07 14:03:08,106 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:08,106 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:08,107 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:08,107 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:08,108 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:08,108 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:08,108 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:08,109 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:08,109 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:08,113 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:08,113 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:08,113 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:08,176 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-98) FINISH, GetAllVmStatsVDSCommand, return: {6c1fcddf-86d6-4533-905b-abb11b775f5b=org.ovirt.engine.core.compat.KeyValuePairCompat@436f513, 2842672f-6230-434f-8232-e88e71560092=org.ovirt.engine.core.compat.KeyValuePairCompat@a4660250, e5a192f1-3f9d-48e1-a817-28f72815c646=org.ovirt.engine.core.compat.KeyValuePairCompat@369970de, 8738bb81-c73e-4a41-a24a-c4c49491c536=org.ovirt.engine.core.compat.KeyValuePairCompat@9753638b, 6a729fb0-47fe-4eba-9ba3-2b939eee2b19=org.ovirt.engine.core.compat.KeyValuePairCompat@abfa29c6, ba81adbe-b311-4aef-b6c1-5f84f0f3c94d=org.ovirt.engine.core.compat.KeyValuePairCompat@51133c89, 54b872c6-cefc-4a19-b48e-9bc1a09285f9=org.ovirt.engine.core.compat.KeyValuePairCompat@3ed3b31f, 9dbe6b1e-2a98-449e-8bd7-2d025c420a42=org.ovirt.engine.core.compat.KeyValuePairCompat@8772aa21}, log id: 7dcb5b90 >2012-08-07 14:03:09,572 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) Server: RunQuery invoked! >2012-08-07 14:03:09,572 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:09,573 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:03:09,731 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-95) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 14:03:09,738 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-95) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 14:03:09,739 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-95) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 14:03:09,739 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-95) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 14:03:10,038 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-4) vds::refreshVmList entered >2012-08-07 14:03:10,042 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:10,043 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:10,043 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:10,043 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:10,044 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:10,044 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:10,045 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:10,045 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:10,046 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:10,046 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:10,046 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:10,047 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:10,350 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-6) vds::refreshVmList entered >2012-08-07 14:03:10,355 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:10,355 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:10,356 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:10,356 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:10,357 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:10,360 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:10,361 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:10,361 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:10,362 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:10,362 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:10,362 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:10,363 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:10,826 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) Server: RunQuery invoked! >2012-08-07 14:03:10,827 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:10,827 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) Server: RunQuery invoked! >2012-08-07 14:03:10,829 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:12,078 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-5) vds::refreshVmList entered >2012-08-07 14:03:12,085 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:12,086 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:12,086 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:12,087 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:12,087 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:12,088 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:12,088 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:12,089 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:12,089 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:12,090 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:12,090 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:12,095 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:12,397 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-7) vds::refreshVmList entered >2012-08-07 14:03:12,403 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:12,404 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:12,404 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:12,404 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:12,405 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:12,405 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:12,406 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:12,406 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:12,407 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:12,410 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:12,410 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:12,410 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:13,504 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-8) START, SpmStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f), log id: 209567e3 >2012-08-07 14:03:13,508 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:13,508 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:13,509 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:13,509 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:13,509 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:13,510 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:13,510 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:13,511 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:13,511 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:13,512 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:13,512 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:13,513 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:13,532 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-8) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@30d778cb, log id: 209567e3 >2012-08-07 14:03:13,534 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-8) START, GetStoragePoolInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 18f10d5f >2012-08-07 14:03:13,543 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:13,544 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:13,544 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:13,545 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:13,545 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:13,546 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:13,546 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:13,547 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:13,547 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:13,548 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:13,548 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:13,549 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:13,590 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-8) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@2e0e93d0, log id: 18f10d5f >2012-08-07 14:03:14,130 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-9) vds::refreshVmList entered >2012-08-07 14:03:14,136 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:14,137 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:14,137 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:14,137 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:14,138 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:14,138 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:14,139 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:14,139 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:14,140 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:14,140 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:14,141 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:14,141 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:14,222 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-10) START, SpmStatusVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23), log id: 2fa2a93c >2012-08-07 14:03:14,231 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:14,231 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:14,232 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:14,232 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:14,233 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:14,233 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:14,234 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:14,234 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:14,234 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:14,235 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:14,238 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:14,238 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:14,440 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-12) vds::refreshVmList entered >2012-08-07 14:03:14,444 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:14,445 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:14,445 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:14,445 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:14,446 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:14,446 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:14,451 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:14,451 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:14,452 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:14,452 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:14,452 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:14,453 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:14,462 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-10) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7a7a5c36, log id: 2fa2a93c >2012-08-07 14:03:14,464 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-10) START, GetStoragePoolInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 7ac0574e >2012-08-07 14:03:14,470 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:14,471 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:14,471 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:14,472 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:14,474 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:14,475 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:14,475 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:14,475 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:14,476 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:14,480 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:14,483 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:14,484 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:14,522 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-10) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@5d2d4c1, log id: 7ac0574e >2012-08-07 14:03:14,570 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-16) Server: RunQuery invoked! >2012-08-07 14:03:14,571 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-16) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:14,572 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:03:15,824 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-17) Server: RunQuery invoked! >2012-08-07 14:03:15,824 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-17) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:15,824 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-4) Server: RunQuery invoked! >2012-08-07 14:03:15,827 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-4) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:16,162 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-17) vds::refreshVmList entered >2012-08-07 14:03:16,169 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:16,169 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:16,169 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:16,170 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:16,170 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:16,171 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:16,173 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:16,173 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:16,174 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:16,174 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:16,175 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:16,175 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:16,509 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-13) vds::refreshVmList entered >2012-08-07 14:03:16,516 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:16,516 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:16,517 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:16,517 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:16,518 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:16,518 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:16,518 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:16,519 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:16,519 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:16,520 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:16,520 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:16,521 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:18,212 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-11) vdsManager::refreshVdsStats entered, vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3 >2012-08-07 14:03:18,213 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-11) START, GetStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@490dc880), log id: 3087c812 >2012-08-07 14:03:18,221 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:18,222 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:18,222 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:18,222 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:18,223 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:18,223 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:18,224 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:18,224 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:18,225 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:18,225 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:18,226 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:18,226 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:18,267 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-11) FINISH, GetStatsVDSCommand, log id: 3087c812 >2012-08-07 14:03:18,268 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-11) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@1a2d4407 >2012-08-07 14:03:18,269 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-11) vds::refreshVmList entered >2012-08-07 14:03:18,272 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-11) START, GetAllVmStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@ccfb4d04), log id: 11cd34fe >2012-08-07 14:03:18,276 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:18,277 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:18,277 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:18,278 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:18,278 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:18,279 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:18,279 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:18,280 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:18,280 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:18,281 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:18,283 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:18,284 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:18,299 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-11) FINISH, GetAllVmStatsVDSCommand, return: {}, log id: 11cd34fe >2012-08-07 14:03:18,548 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-14) vdsManager::refreshVdsStats entered, vds = 4196a566-dee6-11e1-b66e-c35c5273fee7 : purple-vds2 >2012-08-07 14:03:18,549 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-14) START, GetStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@390a1b65), log id: fbb278e >2012-08-07 14:03:18,553 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:18,553 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:18,554 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:18,555 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:18,555 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:18,555 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:18,556 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:18,556 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:18,557 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:18,557 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:18,558 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:18,558 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:18,582 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-14) FINISH, GetStatsVDSCommand, log id: fbb278e >2012-08-07 14:03:18,584 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-14) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@305d9888 >2012-08-07 14:03:18,585 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-14) vds::refreshVmList entered >2012-08-07 14:03:18,585 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-14) START, GetAllVmStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@989d69b5), log id: 50c92186 >2012-08-07 14:03:18,593 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:18,594 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:18,594 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:18,595 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:18,595 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:18,596 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:18,596 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:18,597 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:18,597 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:18,598 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:18,598 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:18,602 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:18,675 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-14) FINISH, GetAllVmStatsVDSCommand, return: {6c1fcddf-86d6-4533-905b-abb11b775f5b=org.ovirt.engine.core.compat.KeyValuePairCompat@76735f13, 2842672f-6230-434f-8232-e88e71560092=org.ovirt.engine.core.compat.KeyValuePairCompat@79f2b953, e5a192f1-3f9d-48e1-a817-28f72815c646=org.ovirt.engine.core.compat.KeyValuePairCompat@12d05cde, 8738bb81-c73e-4a41-a24a-c4c49491c536=org.ovirt.engine.core.compat.KeyValuePairCompat@d6da9c8e, 6a729fb0-47fe-4eba-9ba3-2b939eee2b19=org.ovirt.engine.core.compat.KeyValuePairCompat@29de7452, ba81adbe-b311-4aef-b6c1-5f84f0f3c94d=org.ovirt.engine.core.compat.KeyValuePairCompat@c34fa689, 54b872c6-cefc-4a19-b48e-9bc1a09285f9=org.ovirt.engine.core.compat.KeyValuePairCompat@26b27fab, 9dbe6b1e-2a98-449e-8bd7-2d025c420a42=org.ovirt.engine.core.compat.KeyValuePairCompat@f9af1421}, log id: 50c92186 >2012-08-07 14:03:19,569 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) Server: RunQuery invoked! >2012-08-07 14:03:19,572 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-14) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:19,572 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:03:20,423 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-18) vds::refreshVmList entered >2012-08-07 14:03:20,428 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:20,428 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:20,429 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:20,430 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:20,430 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:20,430 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:20,431 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:20,431 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:20,432 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:20,432 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:20,433 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:20,433 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:20,821 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) Server: RunQuery invoked! >2012-08-07 14:03:20,822 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-18) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:20,824 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) Server: RunQuery invoked! >2012-08-07 14:03:20,825 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-5) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:20,902 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-22) vds::refreshVmList entered >2012-08-07 14:03:20,906 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:20,907 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:20,908 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:20,908 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:20,909 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:20,909 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:20,909 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:20,910 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:20,910 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:20,911 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:20,911 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:20,912 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:22,454 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-23) vds::refreshVmList entered >2012-08-07 14:03:22,461 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:22,461 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:22,462 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:22,462 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:22,463 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:22,463 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:22,464 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:22,464 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:22,465 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:22,465 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:22,466 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:22,466 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:22,941 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-24) vds::refreshVmList entered >2012-08-07 14:03:22,952 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:22,952 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:22,952 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:22,953 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:22,953 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:22,954 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:22,954 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:22,955 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:22,955 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:22,956 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:22,961 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:22,962 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:23,637 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-25) START, SpmStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f), log id: 3ca50ddf >2012-08-07 14:03:23,642 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:23,643 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:23,643 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:23,644 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:23,644 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:23,645 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:23,645 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:23,646 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:23,646 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:23,647 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:23,647 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:23,648 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:23,675 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-25) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7831ca93, log id: 3ca50ddf >2012-08-07 14:03:23,680 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-25) START, GetStoragePoolInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 4cb9b1bd >2012-08-07 14:03:23,687 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:23,688 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:23,688 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:23,689 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:23,689 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:23,692 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:23,695 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:23,695 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:23,696 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:23,696 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:23,697 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:23,697 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:23,750 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-25) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@2e0e93d0, log id: 4cb9b1bd >2012-08-07 14:03:24,486 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-26) vds::refreshVmList entered >2012-08-07 14:03:24,490 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:24,490 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:24,491 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:24,491 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:24,491 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:24,492 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:24,492 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:24,493 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:24,493 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:24,494 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:24,494 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:24,495 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:24,567 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) Server: RunQuery invoked! >2012-08-07 14:03:24,568 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-15) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:24,569 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:03:24,606 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-27) START, SpmStatusVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23), log id: 7ab31ee8 >2012-08-07 14:03:24,609 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:24,610 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:24,610 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:24,611 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:24,611 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:24,613 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:24,614 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:24,614 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:24,615 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:24,619 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:24,620 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:24,622 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:24,655 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-27) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5b25047, log id: 7ab31ee8 >2012-08-07 14:03:24,657 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-27) START, GetStoragePoolInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 25d45ab6 >2012-08-07 14:03:24,663 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:24,664 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:24,664 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:24,665 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:24,665 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:24,666 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:24,666 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:24,667 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:24,667 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:24,668 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:24,668 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:24,671 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:24,710 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-27) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@5d2d4c1, log id: 25d45ab6 >2012-08-07 14:03:25,013 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-28) vds::refreshVmList entered >2012-08-07 14:03:25,018 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:25,018 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:25,018 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:25,019 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:25,019 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:25,020 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:25,020 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:25,021 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:25,021 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:25,022 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:25,022 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:25,023 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:25,824 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) Server: RunQuery invoked! >2012-08-07 14:03:25,825 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-1) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:25,826 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) Server: RunQuery invoked! >2012-08-07 14:03:25,826 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-12) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:26,515 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-30) vds::refreshVmList entered >2012-08-07 14:03:26,520 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:26,521 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:26,521 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:26,521 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:26,522 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:26,523 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:26,524 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:26,524 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:26,525 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:26,525 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:26,525 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:26,530 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:27,044 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-31) vds::refreshVmList entered >2012-08-07 14:03:27,048 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:27,049 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:27,049 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:27,050 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:27,050 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:27,051 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:27,051 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:27,052 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:27,052 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:27,053 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:27,053 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:27,053 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:28,562 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-33) vdsManager::refreshVdsStats entered, vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3 >2012-08-07 14:03:28,563 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-33) START, GetStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@490dc880), log id: 16a74c84 >2012-08-07 14:03:28,568 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:28,568 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:28,568 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:28,569 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:28,569 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:28,570 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:28,570 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:28,574 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:28,574 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:28,575 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:28,575 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:28,576 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:28,602 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-33) FINISH, GetStatsVDSCommand, log id: 16a74c84 >2012-08-07 14:03:28,608 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-33) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@13e9ac7 >2012-08-07 14:03:28,609 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-33) vds::refreshVmList entered >2012-08-07 14:03:28,609 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-33) START, GetAllVmStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@e7ec8843), log id: 35237f74 >2012-08-07 14:03:28,613 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:28,613 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:28,614 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:28,614 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:28,615 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:28,615 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:28,616 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:28,616 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:28,617 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:28,622 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:28,623 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:28,623 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:28,647 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-33) FINISH, GetAllVmStatsVDSCommand, return: {}, log id: 35237f74 >2012-08-07 14:03:29,087 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-34) vdsManager::refreshVdsStats entered, vds = 4196a566-dee6-11e1-b66e-c35c5273fee7 : purple-vds2 >2012-08-07 14:03:29,088 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-34) START, GetStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@531a1edb), log id: 54558a78 >2012-08-07 14:03:29,093 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:29,093 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:29,094 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:29,094 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:29,094 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:29,095 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:29,095 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:29,096 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:29,096 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:29,097 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:29,097 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:29,098 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:29,122 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-34) FINISH, GetStatsVDSCommand, log id: 54558a78 >2012-08-07 14:03:29,124 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-34) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@234b1132 >2012-08-07 14:03:29,124 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-34) vds::refreshVmList entered >2012-08-07 14:03:29,125 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-34) START, GetAllVmStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@c6ed3ca9), log id: 1555fbb8 >2012-08-07 14:03:29,130 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:29,130 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:29,131 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:29,131 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:29,132 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:29,132 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:29,133 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:29,133 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:29,134 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:29,134 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:29,135 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:29,135 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:29,192 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-34) FINISH, GetAllVmStatsVDSCommand, return: {6c1fcddf-86d6-4533-905b-abb11b775f5b=org.ovirt.engine.core.compat.KeyValuePairCompat@b5fa9816, 2842672f-6230-434f-8232-e88e71560092=org.ovirt.engine.core.compat.KeyValuePairCompat@f2d95850, e5a192f1-3f9d-48e1-a817-28f72815c646=org.ovirt.engine.core.compat.KeyValuePairCompat@850cc6de, 8738bb81-c73e-4a41-a24a-c4c49491c536=org.ovirt.engine.core.compat.KeyValuePairCompat@e5c6b98b, 6a729fb0-47fe-4eba-9ba3-2b939eee2b19=org.ovirt.engine.core.compat.KeyValuePairCompat@6156052, ba81adbe-b311-4aef-b6c1-5f84f0f3c94d=org.ovirt.engine.core.compat.KeyValuePairCompat@9f869289, 54b872c6-cefc-4a19-b48e-9bc1a09285f9=org.ovirt.engine.core.compat.KeyValuePairCompat@98eee9ab, 9dbe6b1e-2a98-449e-8bd7-2d025c420a42=org.ovirt.engine.core.compat.KeyValuePairCompat@d5e60021}, log id: 1555fbb8 >2012-08-07 14:03:29,567 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) Server: RunQuery invoked! >2012-08-07 14:03:29,568 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-6) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:29,569 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:03:30,752 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-38) vds::refreshVmList entered >2012-08-07 14:03:30,756 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:30,756 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:30,757 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:30,757 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:30,758 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:30,758 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:30,759 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:30,759 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:30,760 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:30,760 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:30,760 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:30,761 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:30,822 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) Server: RunQuery invoked! >2012-08-07 14:03:30,822 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-3) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:30,826 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) Server: RunQuery invoked! >2012-08-07 14:03:30,826 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-13) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:31,497 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-39) vds::refreshVmList entered >2012-08-07 14:03:31,503 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:31,504 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:31,504 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:31,505 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:31,505 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:31,505 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:31,506 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:31,506 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:31,507 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:31,507 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:31,508 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:31,508 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:32,790 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-40) vds::refreshVmList entered >2012-08-07 14:03:32,799 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:32,800 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:32,800 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:32,801 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:32,804 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:32,805 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:32,806 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:32,806 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:32,807 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:32,810 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:32,811 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:32,811 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:33,534 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-41) vds::refreshVmList entered >2012-08-07 14:03:33,538 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:33,539 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:33,539 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:33,540 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:33,540 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:33,541 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:33,541 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:33,542 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:33,542 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:33,543 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:33,543 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:33,543 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:33,826 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-42) START, SpmStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f), log id: 4b1dd689 >2012-08-07 14:03:33,832 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:33,832 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:33,833 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:33,833 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:33,833 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:33,834 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:33,834 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:33,835 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:33,835 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:33,836 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:33,838 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:33,839 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:33,863 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-42) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@13efe2e6, log id: 4b1dd689 >2012-08-07 14:03:33,865 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-42) START, GetStoragePoolInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 15c0e7a8 >2012-08-07 14:03:33,869 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:33,869 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:33,870 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:33,870 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:33,871 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:33,871 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:33,872 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:33,872 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:33,873 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:33,875 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:33,876 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:33,876 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:33,910 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-42) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@2e0e93d0, log id: 15c0e7a8 >2012-08-07 14:03:34,565 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) Server: RunQuery invoked! >2012-08-07 14:03:34,565 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-11) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:34,566 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:03:34,821 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-43) START, SpmStatusVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23), log id: 1b993ab6 >2012-08-07 14:03:34,826 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:34,826 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:34,827 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:34,827 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:34,828 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:34,828 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:34,829 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:34,829 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:34,830 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:34,830 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:34,830 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:34,831 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:34,846 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-44) vds::refreshVmList entered >2012-08-07 14:03:34,852 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:34,852 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:34,853 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:34,853 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:34,854 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:34,854 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:34,855 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:34,855 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:34,856 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:34,856 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:34,858 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:34,859 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:34,868 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-43) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@4a1073c6, log id: 1b993ab6 >2012-08-07 14:03:34,876 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-43) START, GetStoragePoolInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 45167d3f >2012-08-07 14:03:34,880 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:34,880 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:34,881 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:34,881 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:34,882 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:34,882 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:34,882 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:34,883 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:34,887 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:34,888 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:34,888 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:34,888 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:34,931 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-43) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@5d2d4c1, log id: 45167d3f >2012-08-07 14:03:35,565 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-45) vds::refreshVmList entered >2012-08-07 14:03:35,569 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:35,569 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:35,570 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:35,570 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:35,571 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:35,571 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:35,572 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:35,572 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:35,573 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:35,573 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:35,573 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:35,574 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:35,819 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) Server: RunQuery invoked! >2012-08-07 14:03:35,820 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-2) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:35,822 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) Server: RunQuery invoked! >2012-08-07 14:03:35,822 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-19) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:36,202 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) Server: RunQuery invoked! >2012-08-07 14:03:36,202 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-9) IP [10.35.3.239], Session ID [jmPBXs9cXUOonFcWXtMMzEUr.undefined] >2012-08-07 14:03:36,203 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) Server: RunQuery invoked! >2012-08-07 14:03:36,204 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-10) IP [10.35.3.239], Session ID [jmPBXs9cXUOonFcWXtMMzEUr.undefined] >2012-08-07 14:03:36,899 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-46) vds::refreshVmList entered >2012-08-07 14:03:36,904 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:36,904 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:36,905 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:36,905 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:36,906 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:36,906 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:36,907 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:36,907 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:36,908 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:36,908 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:36,908 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:36,909 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:37,598 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-47) vds::refreshVmList entered >2012-08-07 14:03:37,605 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:37,605 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:37,606 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:37,606 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:37,606 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:37,607 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:37,607 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:37,608 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:37,608 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:37,609 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:37,612 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:37,612 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:38,929 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-48) vdsManager::refreshVdsStats entered, vds = 47028088-dee6-11e1-bffa-2f8f15de3134 : purple-vds3 >2012-08-07 14:03:38,931 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-48) START, GetStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@885219cc), log id: 3b507862 >2012-08-07 14:03:38,936 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:38,937 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:38,937 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:38,938 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:38,938 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:38,938 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:38,939 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:38,939 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:38,940 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:38,940 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:38,941 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:38,941 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:38,995 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-48) FINISH, GetStatsVDSCommand, log id: 3b507862 >2012-08-07 14:03:38,997 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-48) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@576047aa >2012-08-07 14:03:38,998 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-48) vds::refreshVmList entered >2012-08-07 14:03:38,998 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-48) START, GetAllVmStatsVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, vds=org.ovirt.engine.core.common.businessentities.VDS@1ad335cc), log id: 720116b6 >2012-08-07 14:03:39,002 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:39,003 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:39,003 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:39,004 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:39,004 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:39,005 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:39,005 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:39,006 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:39,006 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:39,007 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:39,007 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:39,008 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:39,023 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-48) FINISH, GetAllVmStatsVDSCommand, return: {}, log id: 720116b6 >2012-08-07 14:03:39,565 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) Server: RunQuery invoked! >2012-08-07 14:03:39,565 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-7) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:39,570 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:03:39,636 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-49) vdsManager::refreshVdsStats entered, vds = 4196a566-dee6-11e1-b66e-c35c5273fee7 : purple-vds2 >2012-08-07 14:03:39,637 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-49) START, GetStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@531a1edb), log id: 346a3063 >2012-08-07 14:03:39,643 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:39,643 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:39,643 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:39,644 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:39,644 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:39,645 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:39,645 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:39,646 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:39,647 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:39,647 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:39,648 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:39,648 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:39,674 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (QuartzScheduler_Worker-49) FINISH, GetStatsVDSCommand, log id: 346a3063 >2012-08-07 14:03:39,676 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-49) vds::refreshVdsStats >org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo@66d5fe70 >2012-08-07 14:03:39,676 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-49) vds::refreshVmList entered >2012-08-07 14:03:39,677 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-49) START, GetAllVmStatsVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=org.ovirt.engine.core.common.businessentities.VDS@d536a547), log id: 6b339fce >2012-08-07 14:03:39,681 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:39,681 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:39,682 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:39,682 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:39,682 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:39,683 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:39,683 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:39,684 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:39,684 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:39,685 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:39,685 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:39,686 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:39,753 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (QuartzScheduler_Worker-49) FINISH, GetAllVmStatsVDSCommand, return: {6c1fcddf-86d6-4533-905b-abb11b775f5b=org.ovirt.engine.core.compat.KeyValuePairCompat@28370216, 2842672f-6230-434f-8232-e88e71560092=org.ovirt.engine.core.compat.KeyValuePairCompat@6515c250, e5a192f1-3f9d-48e1-a817-28f72815c646=org.ovirt.engine.core.compat.KeyValuePairCompat@6143b2de, 8738bb81-c73e-4a41-a24a-c4c49491c536=org.ovirt.engine.core.compat.KeyValuePairCompat@c1fda58b, 6a729fb0-47fe-4eba-9ba3-2b939eee2b19=org.ovirt.engine.core.compat.KeyValuePairCompat@7851ca52, ba81adbe-b311-4aef-b6c1-5f84f0f3c94d=org.ovirt.engine.core.compat.KeyValuePairCompat@11c2fc89, 54b872c6-cefc-4a19-b48e-9bc1a09285f9=org.ovirt.engine.core.compat.KeyValuePairCompat@b2b53ab, 9dbe6b1e-2a98-449e-8bd7-2d025c420a42=org.ovirt.engine.core.compat.KeyValuePairCompat@48226a21}, log id: 6b339fce >2012-08-07 14:03:40,822 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) Server: RunQuery invoked! >2012-08-07 14:03:40,823 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-20) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:40,824 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) Server: RunQuery invoked! >2012-08-07 14:03:40,824 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-8) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:41,112 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-56) vds::refreshVmList entered >2012-08-07 14:03:41,117 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:41,117 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:41,117 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:41,118 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:41,118 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:41,119 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:41,119 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:41,120 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:41,120 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:41,121 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:41,121 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:41,121 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:42,112 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-57) vds::refreshVmList entered >2012-08-07 14:03:42,115 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:42,116 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:42,116 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:42,117 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:42,117 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:42,117 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:42,118 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:42,118 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:42,119 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:42,119 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:42,120 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:42,120 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:43,142 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-58) vds::refreshVmList entered >2012-08-07 14:03:43,146 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:43,147 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds3, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:43,147 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:43,148 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:15:04 IDT 2012 >2012-08-07 14:03:43,148 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:15:04 IDT 2017 >2012-08-07 14:03:43,149 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:43,149 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:43,150 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:43,150 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:43,151 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:43,151 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:43,151 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:44,007 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-59) START, SpmStatusVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f), log id: 15afb050 >2012-08-07 14:03:44,012 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 1: >2012-08-07 14:03:44,012 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:44,013 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:44,013 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:44,013 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:44,014 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:44,015 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Server certificate 2: >2012-08-07 14:03:44,015 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:44,016 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:44,016 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:44,017 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:44,017 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-49) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:44,042 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (QuartzScheduler_Worker-59) FINISH, SpmStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@41605f4f, log id: 15afb050 >2012-08-07 14:03:44,044 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-59) START, GetStoragePoolInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = true, compatabilityVersion = null), log id: 251e7aa3 >2012-08-07 14:03:44,048 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:44,048 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:44,049 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:44,049 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:44,049 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:44,050 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:44,050 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:44,051 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:44,051 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:44,056 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:44,057 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:44,057 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:44,095 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (QuartzScheduler_Worker-59) FINISH, GetStoragePoolInfoVDSCommand, return: org.ovirt.engine.core.compat.KeyValuePairCompat@2e0e93d0, log id: 251e7aa3 >2012-08-07 14:03:44,144 DEBUG [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-60) vds::refreshVmList entered >2012-08-07 14:03:44,150 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 1: >2012-08-07 14:03:44,151 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=purple-vds2, O=qa.lab.tlv.redhat.com >2012-08-07 14:03:44,151 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:44,152 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 13:21:11 IDT 2012 >2012-08-07 14:03:44,152 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Fri Aug 04 13:21:11 IDT 2017 >2012-08-07 14:03:44,154 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:44,155 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Server certificate 2: >2012-08-07 14:03:44,155 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Subject DN: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:44,156 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Signature Algorithm: SHA1withRSA >2012-08-07 14:03:44,159 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid from: Sat Aug 04 18:07:16 IDT 2012 >2012-08-07 14:03:44,160 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Valid until: Wed Aug 03 13:07:16 IDT 2022 >2012-08-07 14:03:44,160 DEBUG [org.ovirt.engine.core.utils.ssl.AuthSSLX509TrustManager] (pool-3-thread-50) Issuer: CN=CA-leonid-rhevm31.qa.lab.tlv.redhat.com.76507, O=qa.lab.tlv.redhat.com, C=US >2012-08-07 14:03:44,563 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-16) Server: RunQuery invoked! >2012-08-07 14:03:44,563 DEBUG [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp--127.0.0.1-8009-16) IP [10.35.1.174], Session ID [5VKs7oDGmFP-yXkyXsoHircD.undefined] >2012-08-07 14:03:44,564 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:04:00,989 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) Start time: 8/7/12 2:04 PM >2012-08-07 14:04:01,142 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: CbcCheckOnVdsChange >2012-08-07 14:04:01,162 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: CAEngineKey >2012-08-07 14:04:01,163 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: ENGINEEARLib >2012-08-07 14:04:01,189 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: MinimalETLVersion >2012-08-07 14:04:01,547 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: ScriptsPath >2012-08-07 14:04:01,548 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: SQLServerI18NPrefix >2012-08-07 14:04:01,662 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (MSC service thread 1-2) Failed to decrypt Data must start with zero >2012-08-07 14:04:01,662 ERROR [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (MSC service thread 1-2) Failed to decrypt value for property TruststorePass will be used encrypted value >2012-08-07 14:04:01,760 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) VDSBrokerFrontend: 8/7/12 2:04 PM >2012-08-07 14:04:01,770 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) CpuFlagsManager: 8/7/12 2:04 PM >2012-08-07 14:04:01,771 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-2) Setting audit clean up manager to run at: 35 35 3 * * ? >2012-08-07 14:04:01,819 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) AuditLogCleanupManager: 8/7/12 2:04 PM >2012-08-07 14:04:01,832 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-2) TagsDirector initialization >2012-08-07 14:04:01,875 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-2) Tag root added to tree >2012-08-07 14:04:01,898 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) TagsDirector: 8/7/12 2:04 PM >2012-08-07 14:04:01,916 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) IsoDomainListSyncronizer: 8/7/12 2:04 PM >2012-08-07 14:04:01,972 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) InitHandlers: 8/7/12 2:04 PM >2012-08-07 14:04:01,984 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-2) Code VDS_FENCING_OPERATION_FAILED appears more then once in string table. >2012-08-07 14:04:01,993 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) ErrorTranslator: 8/7/12 2:04 PM >2012-08-07 14:04:01,998 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) VdsErrorTranslator: 8/7/12 2:04 PM >2012-08-07 14:04:01,999 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) Mark uncompleted jobs as UNKNOWN: 8/7/12 2:04 PM >2012-08-07 14:04:02,078 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) JobRepositoryCleanupManager: 8/7/12 2:04 PM >2012-08-07 14:04:02,080 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) AutoRecoveryManager: 8/7/12 2:04 PM >2012-08-07 14:04:02,088 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) ExecutionMessageDirector: 8/7/12 2:04 PM >2012-08-07 14:04:02,120 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-1) InitResourceManager: 8/7/12 2:04 PM >2012-08-07 14:04:02,127 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (MSC service thread 1-2) UsersDomainsCacheManager: 8/7/12 2:04 PM >2012-08-07 14:04:02,130 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-1) ResourceManager::ResourceManager::Entered >2012-08-07 14:04:02,249 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (MSC service thread 1-2) DbUserCacheManager: 8/7/12 2:04 PM >2012-08-07 14:04:02,308 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-1) DbUserCacheManager::refreshAllUserData() - entered >2012-08-07 14:04:07,498 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) Eneterd VdsManager:constructor >2012-08-07 14:04:07,499 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) vdsBroker(purple-vds3,54,321) >2012-08-07 14:04:07,721 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-1) ResourceManager::AddVds - VDS 47028088-dee6-11e1-bffa-2f8f15de3134 was added to the Resource Manager >2012-08-07 14:04:10,771 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: UNASSIGNED not exist in string table >2012-08-07 14:04:10,774 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table >2012-08-07 14:04:10,775 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: DWH_STOPPED not exist in string table >2012-08-07 14:04:10,777 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: DWH_STARTED not exist in string table >2012-08-07 14:04:10,781 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: DWH_ERROR not exist in string table >2012-08-07 14:04:10,785 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2012-08-07 14:04:10,785 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_FAILED_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2012-08-07 14:04:10,786 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2012-08-07 14:04:10,786 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_FAILED_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2012-08-07 14:04:12,724 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) Eneterd VdsManager:constructor >2012-08-07 14:04:12,725 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) vdsBroker(purple-vds2,54,321) >2012-08-07 14:04:12,738 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-1) ResourceManager::AddVds - VDS 4196a566-dee6-11e1-b66e-c35c5273fee7 was added to the Resource Manager >2012-08-07 14:04:12,829 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (MSC service thread 1-1) AsyncTaskManager: Initialization of AsyncTaskManager completed successfully. >2012-08-07 14:04:12,829 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-1) AsyncTaskManager: 8/7/12 2:04 PM >2012-08-07 14:04:12,831 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-1) VdsLoadBalancer: 8/7/12 2:04 PM >2012-08-07 14:04:12,838 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (pool-3-thread-4) MacPoolManager started: 8/7/12 2:04 PM >2012-08-07 14:04:12,978 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-2) Initializing Host: purple-vds3 >2012-08-07 14:04:13,163 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (pool-3-thread-4) MacPoolManager finished: 8/7/12 2:04 PM >2012-08-07 14:04:13,304 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-2) [52d1ca94] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-07 14:04:16,087 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-3) Initializing Host: purple-vds2 >2012-08-07 14:04:16,097 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-3) [2c8ec6eb] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-07 14:04:22,951 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-15) [3b4af1bc] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-07 14:04:22,961 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-16) [7904cb67] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 7a858a05-d5d9-40de-9a4e-c24b1980eb23 Type: StoragePool >2012-08-07 14:04:23,229 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [7904cb67] hostFromVds::selectedVds - purple-vds3, spmStatus SPM, storage pool scsi >2012-08-07 14:04:23,233 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-15) [3b4af1bc] hostFromVds::selectedVds - purple-vds2, spmStatus SPM, storage pool nfs31 >2012-08-07 14:04:23,280 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [7904cb67] Initialize Irs proxy from vds: purple-vds3 >2012-08-07 14:04:23,302 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-15) [3b4af1bc] Initialize Irs proxy from vds: purple-vds2 >2012-08-07 14:04:23,662 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) START, SPMGetAllTasksInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 57534482 >2012-08-07 14:04:23,663 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-19) START, SPMGetAllTasksInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 44e79b9a >2012-08-07 14:04:23,822 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool efe20197-e0a7-49b8-beb4-19b1ed3f8c3f >2012-08-07 14:04:23,829 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) START, HSMGetAllTasksInfoVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7), log id: 2f6bdf26 >2012-08-07 14:04:23,855 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-19) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool 7a858a05-d5d9-40de-9a4e-c24b1980eb23 >2012-08-07 14:04:23,886 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 2f6bdf26 >2012-08-07 14:04:23,887 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 57534482 >2012-08-07 14:04:23,888 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-18) Discovered no tasks on Storage Pool nfs31 >2012-08-07 14:04:23,894 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-19) START, HSMGetAllTasksInfoVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134), log id: 50685952 >2012-08-07 14:04:23,953 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-19) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 50685952 >2012-08-07 14:04:23,954 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-19) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 44e79b9a >2012-08-07 14:04:23,955 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-19) Discovered no tasks on Storage Pool scsi >2012-08-07 14:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-77) Checking autorecoverable hosts >2012-08-07 14:05:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-77) Autorecovering 0 hosts >2012-08-07 14:05:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-77) Checking autorecoverable hosts done >2012-08-07 14:05:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-77) Checking autorecoverable storage domains >2012-08-07 14:05:00,158 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-77) Autorecovering 1 storage domains >2012-08-07 14:05:00,159 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-77) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 14:05:00,228 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-77) [f2973a9] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:05:00,312 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-77) [f2973a9] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 14:05:00,504 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-77) [f2973a9] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:05:00,506 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-77) [f2973a9] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:05 PM >2012-08-07 14:05:00,672 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (QuartzScheduler_Worker-77) [f2973a9] Adding new value to configuration cache. >2012-08-07 14:05:00,676 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (QuartzScheduler_Worker-77) [f2973a9] Didnt find the value of DBI18NPrefix in DB for version general - using default: >2012-08-07 14:05:00,678 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (QuartzScheduler_Worker-77) [f2973a9] Adding new value to configuration cache. >2012-08-07 14:05:00,684 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (QuartzScheduler_Worker-77) [f2973a9] Didnt find the value of DBPagingType in DB for version general - using default: Offset >2012-08-07 14:05:00,685 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (QuartzScheduler_Worker-77) [f2973a9] Adding new value to configuration cache. >2012-08-07 14:05:00,693 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (QuartzScheduler_Worker-77) [f2973a9] Didnt find the value of DBPagingSyntax in DB for version general - using default: OFFSET (%1$s -1) LIMIT %2$s >2012-08-07 14:05:00,694 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (QuartzScheduler_Worker-77) [f2973a9] Adding new value to configuration cache. >2012-08-07 14:05:00,700 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (QuartzScheduler_Worker-77) [f2973a9] Didnt find the value of DBSearchTemplate in DB for version general - using default: SELECT * FROM (%2$s) %1$s) as T1 %3$s >2012-08-07 14:05:00,861 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [f2973a9] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 12c1a91d >2012-08-07 14:05:05,257 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-11) Checking if user admin@internal is an admin, result true >2012-08-07 14:05:05,262 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-11) Running command: LoginAdminUserCommand internal: false. >2012-08-07 14:05:42,950 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/7/12 2:05 PM. Start running CanDoAction for command number 1/5 (Command type: ShutdownVm) >2012-08-07 14:05:42,955 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/7/12 2:05 PM. Start running CanDoAction for command number 2/5 (Command type: ShutdownVm) >2012-08-07 14:05:42,962 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/7/12 2:05 PM. Start running CanDoAction for command number 3/5 (Command type: ShutdownVm) >2012-08-07 14:05:42,966 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/7/12 2:05 PM. Start running CanDoAction for command number 4/5 (Command type: ShutdownVm) >2012-08-07 14:05:42,971 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) Start time: 8/7/12 2:05 PM. Start running CanDoAction for command number 5/5 (Command type: ShutdownVm) >2012-08-07 14:05:43,147 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/7/12 2:05 PM. Finish handling CanDoAction for command number 4/5 (Command type: ShutdownVm) >2012-08-07 14:05:43,151 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/7/12 2:05 PM. Finish handling CanDoAction for command number 3/5 (Command type: ShutdownVm) >2012-08-07 14:05:43,156 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) End time: 8/7/12 2:05 PM. Finish handling CanDoAction for command number 5/5 (Command type: ShutdownVm) >2012-08-07 14:05:43,158 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/7/12 2:05 PM. Finish handling CanDoAction for command number 2/5 (Command type: ShutdownVm) >2012-08-07 14:05:43,178 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/7/12 2:05 PM. Finish handling CanDoAction for command number 1/5 (Command type: ShutdownVm) >2012-08-07 14:05:43,314 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [36f273bd] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 Type: VM >2012-08-07 14:05:43,335 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [36f273bd] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-10). >2012-08-07 14:05:43,336 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [36f273bd] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-10. >2012-08-07 14:05:43,340 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [36f273bd] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, force=false, secondsToWait=30, gracefully=true), log id: 30ef913 >2012-08-07 14:05:43,355 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [36f273bd] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, force=false, secondsToWait=30, gracefully=true), log id: 2adac031 >2012-08-07 14:05:43,469 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [36f273bd] FINISH, DestroyVDSCommand, log id: 2adac031 >2012-08-07 14:05:43,500 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [36f273bd] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 30ef913 >2012-08-07 14:05:43,728 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [328a3ba5] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 Type: VM >2012-08-07 14:05:43,730 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [328a3ba5] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-11). >2012-08-07 14:05:43,731 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [328a3ba5] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-11. >2012-08-07 14:05:43,732 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [328a3ba5] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42, force=false, secondsToWait=30, gracefully=true), log id: 4c1eeff0 >2012-08-07 14:05:43,744 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [328a3ba5] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42, force=false, secondsToWait=30, gracefully=true), log id: 464bc041 >2012-08-07 14:05:43,811 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [328a3ba5] FINISH, DestroyVDSCommand, log id: 464bc041 >2012-08-07 14:05:43,830 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [328a3ba5] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 4c1eeff0 >2012-08-07 14:05:44,009 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [1151e78f] Running command: ShutdownVmCommand internal: false. Entities affected : ID: e5a192f1-3f9d-48e1-a817-28f72815c646 Type: VM >2012-08-07 14:05:44,011 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [1151e78f] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-12). >2012-08-07 14:05:44,012 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [1151e78f] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-12. >2012-08-07 14:05:44,013 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [1151e78f] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, force=false, secondsToWait=30, gracefully=true), log id: 57fd8cd9 >2012-08-07 14:05:44,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [1151e78f] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, force=false, secondsToWait=30, gracefully=true), log id: 59b93a08 >2012-08-07 14:05:44,076 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [1151e78f] FINISH, DestroyVDSCommand, log id: 59b93a08 >2012-08-07 14:05:44,093 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [1151e78f] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 57fd8cd9 >2012-08-07 14:05:44,179 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [1839662b] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 6c1fcddf-86d6-4533-905b-abb11b775f5b Type: VM >2012-08-07 14:05:44,182 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [1839662b] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-13). >2012-08-07 14:05:44,182 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [1839662b] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-13. >2012-08-07 14:05:44,183 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [1839662b] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, force=false, secondsToWait=30, gracefully=true), log id: 401905fe >2012-08-07 14:05:44,188 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [1839662b] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, force=false, secondsToWait=30, gracefully=true), log id: 2a09a2e1 >2012-08-07 14:05:44,256 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [1839662b] FINISH, DestroyVDSCommand, log id: 2a09a2e1 >2012-08-07 14:05:44,280 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [1839662b] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 401905fe >2012-08-07 14:05:44,418 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [60629d79] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 2842672f-6230-434f-8232-e88e71560092 Type: VM >2012-08-07 14:05:44,420 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [60629d79] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-14). >2012-08-07 14:05:44,420 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [60629d79] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-14. >2012-08-07 14:05:44,421 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [60629d79] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, force=false, secondsToWait=30, gracefully=true), log id: 3ed105c2 >2012-08-07 14:05:44,431 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [60629d79] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, force=false, secondsToWait=30, gracefully=true), log id: 41f494a0 >2012-08-07 14:05:44,491 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [60629d79] FINISH, DestroyVDSCommand, log id: 41f494a0 >2012-08-07 14:05:44,507 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [60629d79] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 3ed105c2 >2012-08-07 14:06:03,457 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/7/12 2:06 PM. Start running CanDoAction for command number 1/2 (Command type: ShutdownVm) >2012-08-07 14:06:03,461 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/7/12 2:06 PM. Start running CanDoAction for command number 2/2 (Command type: ShutdownVm) >2012-08-07 14:06:03,481 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/7/12 2:06 PM. Finish handling CanDoAction for command number 2/2 (Command type: ShutdownVm) >2012-08-07 14:06:03,495 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/7/12 2:06 PM. Finish handling CanDoAction for command number 1/2 (Command type: ShutdownVm) >2012-08-07 14:06:03,694 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [673fe9ee] Running command: ShutdownVmCommand internal: false. Entities affected : ID: ba81adbe-b311-4aef-b6c1-5f84f0f3c94d Type: VM >2012-08-07 14:06:03,697 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [673fe9ee] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop new). >2012-08-07 14:06:03,697 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [673fe9ee] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop new. >2012-08-07 14:06:03,698 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [673fe9ee] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=ba81adbe-b311-4aef-b6c1-5f84f0f3c94d, force=false, secondsToWait=30, gracefully=true), log id: 2a3f1ba >2012-08-07 14:06:03,703 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [673fe9ee] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=ba81adbe-b311-4aef-b6c1-5f84f0f3c94d, force=false, secondsToWait=30, gracefully=true), log id: 2eb669d1 >2012-08-07 14:06:03,783 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [673fe9ee] FINISH, DestroyVDSCommand, log id: 2eb669d1 >2012-08-07 14:06:03,807 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [673fe9ee] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 2a3f1ba >2012-08-07 14:06:03,993 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [15173d37] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 Type: VM >2012-08-07 14:06:03,995 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [15173d37] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop lesik). >2012-08-07 14:06:03,996 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [15173d37] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop lesik. >2012-08-07 14:06:03,999 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [15173d37] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=54b872c6-cefc-4a19-b48e-9bc1a09285f9, force=false, secondsToWait=30, gracefully=true), log id: 4349c955 >2012-08-07 14:06:04,242 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [15173d37] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=54b872c6-cefc-4a19-b48e-9bc1a09285f9, force=false, secondsToWait=30, gracefully=true), log id: 1962f3a8 >2012-08-07 14:06:04,299 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [15173d37] FINISH, DestroyVDSCommand, log id: 1962f3a8 >2012-08-07 14:06:04,323 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [15173d37] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 4349c955 >2012-08-07 14:08:00,901 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [f2973a9] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 14:08:00,903 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [f2973a9] FINISH, ConnectStorageServerVDSCommand, log id: 12c1a91d >2012-08-07 14:08:00,904 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [f2973a9] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 14:08:00,912 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-77) [f2973a9] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:08 PM >2012-08-07 14:08:00,918 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-77) [f2973a9] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 220f15d0 >2012-08-07 14:08:01,191 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-77) [f2973a9] Failed in ActivateStorageDomainVDS method >2012-08-07 14:08:01,191 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-77) [f2973a9] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:08:01,192 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-77) [f2973a9] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:08:01,193 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-77) [f2973a9] ERROR, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), exception: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',), log id: 220f15d0: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.createException(BrokerCommandBase.java:201) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.ProceedProxyReturnValue(BrokerCommandBase.java:185) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand.ExecuteIrsBrokerCommand(ActivateStorageDomainVDSCommand.java:18) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand.ExecuteVDSCommand(IrsBrokerCommand.java:1520) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.ExecuteCommand(VDSCommandBase.java:60) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.Execute(VdcCommandBase.java:41) [engine-dal.jar:] > at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:390) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand.executeCommand(ActivateStorageDomainCommand.java:67) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteWithoutTransaction(CommandBase.java:810) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:901) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1256) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:168) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:107) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.Execute(CommandBase.java:916) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteAction(CommandBase.java:275) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:335) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:288) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.check(AutoRecoveryManager.java:96) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.onTimer(AutoRecoveryManager.java:63) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:64) [engine-scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz-2.1.2.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz-2.1.2.jar:] > >2012-08-07 14:08:01,221 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-77) [f2973a9] FINISH, ActivateStorageDomainVDSCommand, log id: 220f15d0 >2012-08-07 14:08:01,222 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-77) [f2973a9] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:08:01,296 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-77) [f2973a9] Command [id=ce2ca863-68d4-4264-a87e-076d56652c26]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 14:08:01,375 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-77) [f2973a9] Checking autorecoverable storage domains done >2012-08-07 14:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Checking autorecoverable hosts >2012-08-07 14:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Autorecovering 0 hosts >2012-08-07 14:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Checking autorecoverable hosts done >2012-08-07 14:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Checking autorecoverable storage domains >2012-08-07 14:10:00,214 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Autorecovering 1 storage domains >2012-08-07 14:10:00,214 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 14:10:00,217 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-85) [1f3f1d9a] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:10:00,353 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-85) [1f3f1d9a] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 14:10:00,403 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-85) [1f3f1d9a] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:10:00,404 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-85) [1f3f1d9a] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:10 PM >2012-08-07 14:10:00,421 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [1f3f1d9a] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 6642781e >2012-08-07 14:10:45,198 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-64) VM pool1-13 6c1fcddf-86d6-4533-905b-abb11b775f5b moved from PoweringDown --> Up >2012-08-07 14:10:45,454 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-64) VM pool1-14 2842672f-6230-434f-8232-e88e71560092 moved from PoweringDown --> Up >2012-08-07 14:10:45,561 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-64) VM pool1-12 e5a192f1-3f9d-48e1-a817-28f72815c646 moved from PoweringDown --> Up >2012-08-07 14:10:45,604 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-64) VM pool1-10 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 moved from PoweringDown --> Up >2012-08-07 14:10:45,647 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-64) VM pool1-11 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 moved from PoweringDown --> Up >2012-08-07 14:11:05,292 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-98) VM new ba81adbe-b311-4aef-b6c1-5f84f0f3c94d moved from PoweringDown --> Up >2012-08-07 14:11:05,356 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-98) VM lesik 54b872c6-cefc-4a19-b48e-9bc1a09285f9 moved from PoweringDown --> Up >2012-08-07 14:13:00,426 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [1f3f1d9a] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 14:13:00,428 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [1f3f1d9a] FINISH, ConnectStorageServerVDSCommand, log id: 6642781e >2012-08-07 14:13:00,428 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [1f3f1d9a] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 14:13:00,433 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-85) [1f3f1d9a] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:13 PM >2012-08-07 14:13:00,439 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-85) [1f3f1d9a] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 2d98cd7e >2012-08-07 14:13:00,708 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-85) [1f3f1d9a] Failed in ActivateStorageDomainVDS method >2012-08-07 14:13:00,709 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-85) [1f3f1d9a] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:13:00,710 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) [1f3f1d9a] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:13:00,711 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) [1f3f1d9a] ERROR, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), exception: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',), log id: 2d98cd7e: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.createException(BrokerCommandBase.java:201) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.ProceedProxyReturnValue(BrokerCommandBase.java:185) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand.ExecuteIrsBrokerCommand(ActivateStorageDomainVDSCommand.java:18) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand.ExecuteVDSCommand(IrsBrokerCommand.java:1520) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.ExecuteCommand(VDSCommandBase.java:60) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.Execute(VdcCommandBase.java:41) [engine-dal.jar:] > at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:390) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand.executeCommand(ActivateStorageDomainCommand.java:67) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteWithoutTransaction(CommandBase.java:810) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:901) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1256) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:168) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:107) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.Execute(CommandBase.java:916) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteAction(CommandBase.java:275) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:335) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:288) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.check(AutoRecoveryManager.java:96) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.onTimer(AutoRecoveryManager.java:63) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:64) [engine-scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz-2.1.2.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz-2.1.2.jar:] > >2012-08-07 14:13:00,733 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-85) [1f3f1d9a] FINISH, ActivateStorageDomainVDSCommand, log id: 2d98cd7e >2012-08-07 14:13:00,733 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-85) [1f3f1d9a] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:13:00,769 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-85) [1f3f1d9a] Command [id=ae4097c4-339e-43da-969b-a47ef51d7e00]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 14:13:00,785 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) [1f3f1d9a] Checking autorecoverable storage domains done >2012-08-07 14:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Checking autorecoverable hosts >2012-08-07 14:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Autorecovering 0 hosts >2012-08-07 14:15:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Checking autorecoverable hosts done >2012-08-07 14:15:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Checking autorecoverable storage domains >2012-08-07 14:15:00,075 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Autorecovering 1 storage domains >2012-08-07 14:15:00,076 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 14:15:00,078 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-4) [73eb5dcb] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:15:00,183 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-4) [73eb5dcb] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 14:15:00,260 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-4) [73eb5dcb] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:15:00,261 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-4) [73eb5dcb] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:15 PM >2012-08-07 14:15:00,275 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [73eb5dcb] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 22c574dc >2012-08-07 14:18:00,279 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [73eb5dcb] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 14:18:00,280 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [73eb5dcb] FINISH, ConnectStorageServerVDSCommand, log id: 22c574dc >2012-08-07 14:18:00,280 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [73eb5dcb] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 14:18:00,294 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-4) [73eb5dcb] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:18 PM >2012-08-07 14:18:00,295 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-4) [73eb5dcb] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 4aba01fb >2012-08-07 14:18:00,572 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-4) [73eb5dcb] Failed in ActivateStorageDomainVDS method >2012-08-07 14:18:00,572 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-4) [73eb5dcb] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:18:00,573 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-4) [73eb5dcb] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:18:00,574 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-4) [73eb5dcb] ERROR, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), exception: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',), log id: 4aba01fb: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.createException(BrokerCommandBase.java:201) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.ProceedProxyReturnValue(BrokerCommandBase.java:185) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand.ExecuteIrsBrokerCommand(ActivateStorageDomainVDSCommand.java:18) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand.ExecuteVDSCommand(IrsBrokerCommand.java:1520) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.ExecuteCommand(VDSCommandBase.java:60) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.Execute(VdcCommandBase.java:41) [engine-dal.jar:] > at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:390) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand.executeCommand(ActivateStorageDomainCommand.java:67) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteWithoutTransaction(CommandBase.java:810) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:901) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1256) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:168) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:107) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.Execute(CommandBase.java:916) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteAction(CommandBase.java:275) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:335) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:288) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.check(AutoRecoveryManager.java:96) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.onTimer(AutoRecoveryManager.java:63) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:64) [engine-scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz-2.1.2.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz-2.1.2.jar:] > >2012-08-07 14:18:00,609 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-4) [73eb5dcb] FINISH, ActivateStorageDomainVDSCommand, log id: 4aba01fb >2012-08-07 14:18:00,609 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-4) [73eb5dcb] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:18:00,631 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-4) [73eb5dcb] Command [id=d2d2f77f-acb6-4228-b071-1298af4c65bd]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 14:18:00,675 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) [73eb5dcb] Checking autorecoverable storage domains done >2012-08-07 14:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable hosts >2012-08-07 14:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering 0 hosts >2012-08-07 14:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable hosts done >2012-08-07 14:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable storage domains >2012-08-07 14:20:00,079 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering 1 storage domains >2012-08-07 14:20:00,079 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 14:20:00,082 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [7d2ee282] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:20:00,217 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [7d2ee282] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 14:20:00,238 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [7d2ee282] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:20:00,239 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [7d2ee282] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:20 PM >2012-08-07 14:20:00,252 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [7d2ee282] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 449ab364 >2012-08-07 14:23:00,256 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [7d2ee282] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 14:23:00,261 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [7d2ee282] FINISH, ConnectStorageServerVDSCommand, log id: 449ab364 >2012-08-07 14:23:00,262 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [7d2ee282] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 14:23:00,268 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [7d2ee282] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:23 PM >2012-08-07 14:23:00,269 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-22) [7d2ee282] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 359b78ae >2012-08-07 14:23:00,522 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-22) [7d2ee282] Failed in ActivateStorageDomainVDS method >2012-08-07 14:23:00,522 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-22) [7d2ee282] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:23:00,523 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) [7d2ee282] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:23:00,524 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) [7d2ee282] ERROR, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), exception: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',), log id: 359b78ae: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.createException(BrokerCommandBase.java:201) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.ProceedProxyReturnValue(BrokerCommandBase.java:185) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand.ExecuteIrsBrokerCommand(ActivateStorageDomainVDSCommand.java:18) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand.ExecuteVDSCommand(IrsBrokerCommand.java:1520) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.ExecuteCommand(VDSCommandBase.java:60) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.Execute(VdcCommandBase.java:41) [engine-dal.jar:] > at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:390) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand.executeCommand(ActivateStorageDomainCommand.java:67) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteWithoutTransaction(CommandBase.java:810) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:901) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1256) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:168) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:107) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.Execute(CommandBase.java:916) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteAction(CommandBase.java:275) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:335) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:288) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.check(AutoRecoveryManager.java:96) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.onTimer(AutoRecoveryManager.java:63) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:64) [engine-scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz-2.1.2.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz-2.1.2.jar:] > >2012-08-07 14:23:00,573 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-22) [7d2ee282] FINISH, ActivateStorageDomainVDSCommand, log id: 359b78ae >2012-08-07 14:23:00,574 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [7d2ee282] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:23:00,588 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-22) [7d2ee282] Command [id=08310f55-4794-4c50-9540-6782cf62106a]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 14:23:00,638 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) [7d2ee282] Checking autorecoverable storage domains done >2012-08-07 14:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Checking autorecoverable hosts >2012-08-07 14:25:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Autorecovering 0 hosts >2012-08-07 14:25:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Checking autorecoverable hosts done >2012-08-07 14:25:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Checking autorecoverable storage domains >2012-08-07 14:25:00,167 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Autorecovering 1 storage domains >2012-08-07 14:25:00,167 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 14:25:00,170 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-44) [728415e3] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:25:00,222 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-44) [728415e3] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 14:25:00,245 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-44) [728415e3] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:25:00,246 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-44) [728415e3] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:25 PM >2012-08-07 14:25:00,259 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [728415e3] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 1285a880 >2012-08-07 14:28:00,263 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-47) [728415e3] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 14:28:00,263 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-47) [728415e3] FINISH, ConnectStorageServerVDSCommand, log id: 1285a880 >2012-08-07 14:28:00,264 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-47) [728415e3] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 14:28:00,283 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-44) [728415e3] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:28 PM >2012-08-07 14:28:00,284 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-44) [728415e3] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 5f15eff9 >2012-08-07 14:28:00,546 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-44) [728415e3] Failed in ActivateStorageDomainVDS method >2012-08-07 14:28:00,547 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-44) [728415e3] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:28:00,548 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) [728415e3] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:28:00,549 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) [728415e3] ERROR, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), exception: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',), log id: 5f15eff9: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.createException(BrokerCommandBase.java:201) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.ProceedProxyReturnValue(BrokerCommandBase.java:185) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand.ExecuteIrsBrokerCommand(ActivateStorageDomainVDSCommand.java:18) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand.ExecuteVDSCommand(IrsBrokerCommand.java:1520) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.ExecuteCommand(VDSCommandBase.java:60) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.Execute(VdcCommandBase.java:41) [engine-dal.jar:] > at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:390) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand.executeCommand(ActivateStorageDomainCommand.java:67) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteWithoutTransaction(CommandBase.java:810) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:901) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1256) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:168) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:107) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.Execute(CommandBase.java:916) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteAction(CommandBase.java:275) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:335) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:288) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.check(AutoRecoveryManager.java:96) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.onTimer(AutoRecoveryManager.java:63) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:64) [engine-scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz-2.1.2.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz-2.1.2.jar:] > >2012-08-07 14:28:00,572 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-44) [728415e3] FINISH, ActivateStorageDomainVDSCommand, log id: 5f15eff9 >2012-08-07 14:28:00,573 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-44) [728415e3] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:28:00,587 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-44) [728415e3] Command [id=f9d26a38-32a3-4592-b827-5c959157f5db]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 14:28:00,631 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) [728415e3] Checking autorecoverable storage domains done >2012-08-07 14:28:53,967 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-49) [34490808] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 Type: VM >2012-08-07 14:28:53,970 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-49) [34490808] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-10). >2012-08-07 14:28:53,971 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-49) [34490808] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-10. >2012-08-07 14:28:53,973 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-49) [34490808] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, force=false, secondsToWait=30, gracefully=true), log id: 5ba9541a >2012-08-07 14:28:53,979 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-49) [34490808] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, force=false, secondsToWait=30, gracefully=true), log id: 2620b22d >2012-08-07 14:28:54,047 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-49) [34490808] FINISH, DestroyVDSCommand, log id: 2620b22d >2012-08-07 14:28:54,104 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-49) [34490808] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 5ba9541a >2012-08-07 14:29:07,678 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-49) [39a08988] Running command: StopVmCommand internal: false. Entities affected : ID: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 Type: VM >2012-08-07 14:29:07,680 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-49) [39a08988] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42, force=false, secondsToWait=0, gracefully=false), log id: 11048b94 >2012-08-07 14:29:07,690 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-49) [39a08988] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42, force=false, secondsToWait=0, gracefully=false), log id: 3bfe489 >2012-08-07 14:29:08,052 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-49) [39a08988] FINISH, DestroyVDSCommand, log id: 3bfe489 >2012-08-07 14:29:08,081 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-49) [39a08988] FINISH, DestroyVmVDSCommand, return: Down, log id: 11048b94 >2012-08-07 14:29:15,414 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-47) [5d9b035f] Running command: StopVmCommand internal: false. Entities affected : ID: e5a192f1-3f9d-48e1-a817-28f72815c646 Type: VM >2012-08-07 14:29:15,417 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-47) [5d9b035f] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, force=false, secondsToWait=0, gracefully=false), log id: 60c88de4 >2012-08-07 14:29:15,465 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-47) [5d9b035f] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, force=false, secondsToWait=0, gracefully=false), log id: 6cf37b80 >2012-08-07 14:29:15,850 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-47) [5d9b035f] FINISH, DestroyVDSCommand, log id: 6cf37b80 >2012-08-07 14:29:15,900 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-47) [5d9b035f] FINISH, DestroyVmVDSCommand, return: Down, log id: 60c88de4 >2012-08-07 14:29:19,728 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-44) [12155b34] Running command: StopVmCommand internal: false. Entities affected : ID: 6c1fcddf-86d6-4533-905b-abb11b775f5b Type: VM >2012-08-07 14:29:19,736 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [12155b34] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, force=false, secondsToWait=0, gracefully=false), log id: 108ed99f >2012-08-07 14:29:19,743 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [12155b34] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, force=false, secondsToWait=0, gracefully=false), log id: 18b3f6ba >2012-08-07 14:29:20,095 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [12155b34] FINISH, DestroyVDSCommand, log id: 18b3f6ba >2012-08-07 14:29:20,126 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [12155b34] FINISH, DestroyVmVDSCommand, return: Down, log id: 108ed99f >2012-08-07 14:29:24,017 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-47) [410ab750] Running command: StopVmCommand internal: false. Entities affected : ID: 2842672f-6230-434f-8232-e88e71560092 Type: VM >2012-08-07 14:29:24,023 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-47) [410ab750] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, force=false, secondsToWait=0, gracefully=false), log id: 4777d173 >2012-08-07 14:29:24,030 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-47) [410ab750] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, force=false, secondsToWait=0, gracefully=false), log id: 701a9ae6 >2012-08-07 14:29:24,393 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-47) [410ab750] FINISH, DestroyVDSCommand, log id: 701a9ae6 >2012-08-07 14:29:24,434 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-47) [410ab750] FINISH, DestroyVmVDSCommand, return: Down, log id: 4777d173 >2012-08-07 14:29:27,322 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-44) [2901c9cc] Running command: StopVmCommand internal: false. Entities affected : ID: 54b872c6-cefc-4a19-b48e-9bc1a09285f9 Type: VM >2012-08-07 14:29:27,324 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [2901c9cc] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=54b872c6-cefc-4a19-b48e-9bc1a09285f9, force=false, secondsToWait=0, gracefully=false), log id: 21c675dd >2012-08-07 14:29:27,333 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [2901c9cc] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=54b872c6-cefc-4a19-b48e-9bc1a09285f9, force=false, secondsToWait=0, gracefully=false), log id: 1f6de121 >2012-08-07 14:29:27,698 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [2901c9cc] FINISH, DestroyVDSCommand, log id: 1f6de121 >2012-08-07 14:29:27,716 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [2901c9cc] FINISH, DestroyVmVDSCommand, return: Down, log id: 21c675dd >2012-08-07 14:29:30,900 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-44) [311bfdd9] Running command: StopVmCommand internal: false. Entities affected : ID: ba81adbe-b311-4aef-b6c1-5f84f0f3c94d Type: VM >2012-08-07 14:29:30,903 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [311bfdd9] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=ba81adbe-b311-4aef-b6c1-5f84f0f3c94d, force=false, secondsToWait=0, gracefully=false), log id: 498b3b06 >2012-08-07 14:29:30,914 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [311bfdd9] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=ba81adbe-b311-4aef-b6c1-5f84f0f3c94d, force=false, secondsToWait=0, gracefully=false), log id: 2a62868a >2012-08-07 14:29:31,287 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-44) [311bfdd9] FINISH, DestroyVDSCommand, log id: 2a62868a >2012-08-07 14:29:31,304 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-44) [311bfdd9] FINISH, DestroyVmVDSCommand, return: Down, log id: 498b3b06 >2012-08-07 14:29:50,721 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-47) [786b38cb] Running command: StopVmCommand internal: false. Entities affected : ID: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 Type: VM >2012-08-07 14:29:50,723 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-47) [786b38cb] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, force=false, secondsToWait=0, gracefully=false), log id: 2df1f0e >2012-08-07 14:29:50,729 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-47) [786b38cb] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, force=false, secondsToWait=0, gracefully=false), log id: 433fac0d >2012-08-07 14:29:51,112 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-47) [786b38cb] FINISH, DestroyVDSCommand, log id: 433fac0d >2012-08-07 14:29:51,152 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-47) [786b38cb] FINISH, DestroyVmVDSCommand, return: Down, log id: 2df1f0e >2012-08-07 14:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) Checking autorecoverable hosts >2012-08-07 14:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) Autorecovering 0 hosts >2012-08-07 14:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) Checking autorecoverable hosts done >2012-08-07 14:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) Checking autorecoverable storage domains >2012-08-07 14:30:00,092 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) Autorecovering 1 storage domains >2012-08-07 14:30:00,092 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 14:30:00,094 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-67) [707b1ff5] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:30:00,143 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-67) [707b1ff5] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 14:30:00,169 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-67) [707b1ff5] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:30:00,170 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-67) [707b1ff5] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:30 PM >2012-08-07 14:30:00,186 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [707b1ff5] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 29a1f0 >2012-08-07 14:30:03,060 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) Start time: 8/7/12 2:30 PM. Start running CanDoAction for command number 1/10 (Command type: RunVm) >2012-08-07 14:30:03,061 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) Start time: 8/7/12 2:30 PM. Start running CanDoAction for command number 2/10 (Command type: RunVm) >2012-08-07 14:30:03,063 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/7/12 2:30 PM. Start running CanDoAction for command number 3/10 (Command type: RunVm) >2012-08-07 14:30:03,066 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/7/12 2:30 PM. Start running CanDoAction for command number 4/10 (Command type: RunVm) >2012-08-07 14:30:03,068 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/7/12 2:30 PM. Start running CanDoAction for command number 5/10 (Command type: RunVm) >2012-08-07 14:30:03,069 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/7/12 2:30 PM. Start running CanDoAction for command number 6/10 (Command type: RunVm) >2012-08-07 14:30:03,070 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) Start time: 8/7/12 2:30 PM. Start running CanDoAction for command number 7/10 (Command type: RunVm) >2012-08-07 14:30:03,071 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-41) Start time: 8/7/12 2:30 PM. Start running CanDoAction for command number 8/10 (Command type: RunVm) >2012-08-07 14:30:03,073 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-40) Start time: 8/7/12 2:30 PM. Start running CanDoAction for command number 9/10 (Command type: RunVm) >2012-08-07 14:30:03,074 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-39) Start time: 8/7/12 2:30 PM. Start running CanDoAction for command number 10/10 (Command type: RunVm) >2012-08-07 14:30:03,330 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) Lock Acquired to object EngineLock [exclusiveLocks= key: 3c7c0453-5f05-4314-bdd4-eb4fd243f80a value: VM >, sharedLocks= ] >2012-08-07 14:30:03,331 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) Lock Acquired to object EngineLock [exclusiveLocks= key: 6c1fcddf-86d6-4533-905b-abb11b775f5b value: VM >, sharedLocks= ] >2012-08-07 14:30:03,333 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) Lock Acquired to object EngineLock [exclusiveLocks= key: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 value: VM >, sharedLocks= ] >2012-08-07 14:30:03,343 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) Lock Acquired to object EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-07 14:30:03,344 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-39) Lock Acquired to object EngineLock [exclusiveLocks= key: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 value: VM >, sharedLocks= ] >2012-08-07 14:30:03,344 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) Lock Acquired to object EngineLock [exclusiveLocks= key: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 value: VM >, sharedLocks= ] >2012-08-07 14:30:03,345 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) Lock Acquired to object EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] >2012-08-07 14:30:03,346 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) Lock Acquired to object EngineLock [exclusiveLocks= key: e5a192f1-3f9d-48e1-a817-28f72815c646 value: VM >, sharedLocks= ] >2012-08-07 14:30:03,346 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-43) Lock Acquired to object EngineLock [exclusiveLocks= key: 2842672f-6230-434f-8232-e88e71560092 value: VM >, sharedLocks= ] >2012-08-07 14:30:03,400 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-40) Lock Acquired to object EngineLock [exclusiveLocks= key: d3c805a2-419c-480f-8627-f5c9ef5c4117 value: VM >, sharedLocks= ] >2012-08-07 14:30:03,553 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-40) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 205d50ab >2012-08-07 14:30:03,765 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-40) FINISH, IsValidVDSCommand, return: true, log id: 205d50ab >2012-08-07 14:30:03,772 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 3fdb291 >2012-08-07 14:30:03,768 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-41) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 5568dd08 >2012-08-07 14:30:03,765 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-39) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 2857b1d3 >2012-08-07 14:30:03,776 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) FINISH, IsValidVDSCommand, return: true, log id: 3fdb291 >2012-08-07 14:30:03,777 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-41) FINISH, IsValidVDSCommand, return: true, log id: 5568dd08 >2012-08-07 14:30:03,780 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-39) FINISH, IsValidVDSCommand, return: true, log id: 2857b1d3 >2012-08-07 14:30:03,912 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-41) START, IsVmDuringInitiatingVDSCommand(vmId = 6df57989-99a7-4ec9-8f7c-15f222064e61), log id: 776eb9c0 >2012-08-07 14:30:03,913 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-41) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 776eb9c0 >2012-08-07 14:30:03,952 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-40) START, IsVmDuringInitiatingVDSCommand(vmId = d3c805a2-419c-480f-8627-f5c9ef5c4117), log id: 779b9e94 >2012-08-07 14:30:03,954 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-40) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 779b9e94 >2012-08-07 14:30:03,952 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-39) START, IsVmDuringInitiatingVDSCommand(vmId = a7d2a056-b67b-4bc5-b8ea-7afef2d2b861), log id: 4876a58f >2012-08-07 14:30:03,957 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-39) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 4876a58f >2012-08-07 14:30:03,966 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) START, IsVmDuringInitiatingVDSCommand(vmId = 9dbe6b1e-2a98-449e-8bd7-2d025c420a42), log id: 3ae17467 >2012-08-07 14:30:03,967 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 3ae17467 >2012-08-07 14:30:04,067 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 624baa73 >2012-08-07 14:30:04,076 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4a7902ae >2012-08-07 14:30:04,103 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 82373f6 >2012-08-07 14:30:04,106 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) FINISH, IsValidVDSCommand, return: true, log id: 82373f6 >2012-08-07 14:30:04,109 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 36d5160d >2012-08-07 14:30:04,116 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) FINISH, IsValidVDSCommand, return: true, log id: 624baa73 >2012-08-07 14:30:04,118 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 220c9e38 >2012-08-07 14:30:04,154 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/7/12 2:30 PM. Finish handling CanDoAction for command number 3/10 (Command type: RunVm) >2012-08-07 14:30:04,155 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-40) End time: 8/7/12 2:30 PM. Finish handling CanDoAction for command number 9/10 (Command type: RunVm) >2012-08-07 14:30:04,156 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) FINISH, IsValidVDSCommand, return: true, log id: 4a7902ae >2012-08-07 14:30:04,158 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) FINISH, IsValidVDSCommand, return: true, log id: 36d5160d >2012-08-07 14:30:04,160 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-39) End time: 8/7/12 2:30 PM. Finish handling CanDoAction for command number 10/10 (Command type: RunVm) >2012-08-07 14:30:04,160 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 7f46c2e6 >2012-08-07 14:30:04,186 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) FINISH, IsValidVDSCommand, return: true, log id: 220c9e38 >2012-08-07 14:30:04,200 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) FINISH, IsValidVDSCommand, return: true, log id: 7f46c2e6 >2012-08-07 14:30:04,218 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-41) End time: 8/7/12 2:30 PM. Finish handling CanDoAction for command number 8/10 (Command type: RunVm) >2012-08-07 14:30:04,246 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) START, IsVmDuringInitiatingVDSCommand(vmId = 6a729fb0-47fe-4eba-9ba3-2b939eee2b19), log id: c4fd711 >2012-08-07 14:30:04,246 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: c4fd711 >2012-08-07 14:30:04,260 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) End time: 8/7/12 2:30 PM. Finish handling CanDoAction for command number 2/10 (Command type: RunVm) >2012-08-07 14:30:04,551 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) START, IsVmDuringInitiatingVDSCommand(vmId = e5a192f1-3f9d-48e1-a817-28f72815c646), log id: 1eb151e0 >2012-08-07 14:30:04,551 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 1eb151e0 >2012-08-07 14:30:04,567 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-48) START, IsVmDuringInitiatingVDSCommand(vmId = 3c7c0453-5f05-4314-bdd4-eb4fd243f80a), log id: 30cd4eb7 >2012-08-07 14:30:04,568 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-48) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 30cd4eb7 >2012-08-07 14:30:04,569 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-43) START, IsVmDuringInitiatingVDSCommand(vmId = 2842672f-6230-434f-8232-e88e71560092), log id: 3881e7d6 >2012-08-07 14:30:04,570 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-43) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 3881e7d6 >2012-08-07 14:30:04,569 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) START, IsVmDuringInitiatingVDSCommand(vmId = 6c1fcddf-86d6-4533-905b-abb11b775f5b), log id: 5c66db39 >2012-08-07 14:30:04,575 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 5c66db39 >2012-08-07 14:30:04,569 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-42) START, IsVmDuringInitiatingVDSCommand(vmId = 5524b98a-aa45-49cb-9d8b-bec3884753c9), log id: 55248ca5 >2012-08-07 14:30:04,578 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-42) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 55248ca5 >2012-08-07 14:30:04,604 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/7/12 2:30 PM. Finish handling CanDoAction for command number 4/10 (Command type: RunVm) >2012-08-07 14:30:04,638 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/7/12 2:30 PM. Finish handling CanDoAction for command number 5/10 (Command type: RunVm) >2012-08-07 14:30:04,655 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) End time: 8/7/12 2:30 PM. Finish handling CanDoAction for command number 7/10 (Command type: RunVm) >2012-08-07 14:30:04,661 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/7/12 2:30 PM. Finish handling CanDoAction for command number 6/10 (Command type: RunVm) >2012-08-07 14:30:04,668 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) End time: 8/7/12 2:30 PM. Finish handling CanDoAction for command number 1/10 (Command type: RunVm) >2012-08-07 14:30:04,669 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) Start time: 8/7/12 2:30 PM. Start running CanDoAction for command number 13/14 (Command type: RunVm) >2012-08-07 14:30:04,670 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/7/12 2:30 PM. Start running CanDoAction for command number 14/14 (Command type: RunVm) >2012-08-07 14:30:04,670 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/7/12 2:30 PM. Start running CanDoAction for command number 12/14 (Command type: RunVm) >2012-08-07 14:30:04,671 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) Start time: 8/7/12 2:30 PM. Start running CanDoAction for command number 11/14 (Command type: RunVm) >2012-08-07 14:30:04,744 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) Lock Acquired to object EngineLock [exclusiveLocks= key: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 value: VM >, sharedLocks= ] >2012-08-07 14:30:04,749 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) Lock Acquired to object EngineLock [exclusiveLocks= key: c1cb365c-a119-493c-964c-faf65a10c889 value: VM >, sharedLocks= ] >2012-08-07 14:30:04,761 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) Lock Acquired to object EngineLock [exclusiveLocks= key: 3ce0f220-6cb8-42d8-b922-7003c60ccdad value: VM >, sharedLocks= ] >2012-08-07 14:30:04,767 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-43) Lock Acquired to object EngineLock [exclusiveLocks= key: c7702cf0-88da-4885-9b9c-9e59772b3774 value: VM >, sharedLocks= ] >2012-08-07 14:30:04,784 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 3ccbe2cb >2012-08-07 14:30:04,788 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 16a727b9 >2012-08-07 14:30:04,789 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1779f8df >2012-08-07 14:30:04,791 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) FINISH, IsValidVDSCommand, return: true, log id: 3ccbe2cb >2012-08-07 14:30:04,795 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) FINISH, IsValidVDSCommand, return: true, log id: 1779f8df >2012-08-07 14:30:04,799 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) FINISH, IsValidVDSCommand, return: true, log id: 16a727b9 >2012-08-07 14:30:04,814 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 98af2a8 >2012-08-07 14:30:04,816 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) FINISH, IsValidVDSCommand, return: true, log id: 98af2a8 >2012-08-07 14:30:05,028 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) START, IsVmDuringInitiatingVDSCommand(vmId = 96405d4a-a3bd-4900-ab90-9c8736cb02a5), log id: 2d98a257 >2012-08-07 14:30:05,028 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 2d98a257 >2012-08-07 14:30:05,041 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/7/12 2:30 PM. Finish handling CanDoAction for command number 14/14 (Command type: RunVm) >2012-08-07 14:30:05,128 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-48) START, IsVmDuringInitiatingVDSCommand(vmId = c1cb365c-a119-493c-964c-faf65a10c889), log id: 2de749fd >2012-08-07 14:30:05,129 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-48) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 2de749fd >2012-08-07 14:30:05,131 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-42) START, IsVmDuringInitiatingVDSCommand(vmId = 3ce0f220-6cb8-42d8-b922-7003c60ccdad), log id: 1658ba74 >2012-08-07 14:30:05,132 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-42) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 1658ba74 >2012-08-07 14:30:05,134 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-43) START, IsVmDuringInitiatingVDSCommand(vmId = c7702cf0-88da-4885-9b9c-9e59772b3774), log id: 798fd71b >2012-08-07 14:30:05,134 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-43) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 798fd71b >2012-08-07 14:30:05,151 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/7/12 2:30 PM. Finish handling CanDoAction for command number 12/14 (Command type: RunVm) >2012-08-07 14:30:05,151 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) End time: 8/7/12 2:30 PM. Finish handling CanDoAction for command number 13/14 (Command type: RunVm) >2012-08-07 14:30:05,156 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) End time: 8/7/12 2:30 PM. Finish handling CanDoAction for command number 11/14 (Command type: RunVm) >2012-08-07 14:30:05,337 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [4fd46f1b] Running command: RunVmCommand internal: false. Entities affected : ID: e5a192f1-3f9d-48e1-a817-28f72815c646 Type: VM >2012-08-07 14:30:05,455 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [4fd46f1b] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, vm=org.ovirt.engine.core.common.businessentities.VM@1e49904b), log id: 5f797275 >2012-08-07 14:30:05,499 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [4fd46f1b] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, vm=org.ovirt.engine.core.common.businessentities.VM@1e49904b), log id: 339d83ea >2012-08-07 14:30:05,647 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [4fd46f1b] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=e5a192f1-3f9d-48e1-a817-28f72815c646,devices=[Ljava.util.Map;@1a1f5f3c,acpiEnable=true,vmName=pool1-12,cpuType=Conroe,custom={device_036b0e2d-319b-4b26-a6c1-676f9952948fdevice_6842c230-5152-40b4-8477-b9f4c12ae85fdevice_398c99f5-0838-4dfc-a76c-5b881c56d32e=VmId=e5a192f1-3f9d-48e1-a817-28f72815c646,DeviceId=398c99f5-0838-4dfc-a76c-5b881c56d32e,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_036b0e2d-319b-4b26-a6c1-676f9952948fdevice_6842c230-5152-40b4-8477-b9f4c12ae85f=VmId=e5a192f1-3f9d-48e1-a817-28f72815c646,DeviceId=6842c230-5152-40b4-8477-b9f4c12ae85f,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_036b0e2d-319b-4b26-a6c1-676f9952948fdevice_6842c230-5152-40b4-8477-b9f4c12ae85fdevice_398c99f5-0838-4dfc-a76c-5b881c56d32edevice_9fbdc770-4d52-4eca-8671-76e435bb50e8device_d6343ba9-ab3e-436f-bfdd-eb86df4d6635=VmId=e5a192f1-3f9d-48e1-a817-28f72815c646,DeviceId=d6343ba9-ab3e-436f-bfdd-eb86df4d6635,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_036b0e2d-319b-4b26-a6c1-676f9952948f=VmId=e5a192f1-3f9d-48e1-a817-28f72815c646,DeviceId=036b0e2d-319b-4b26-a6c1-676f9952948f,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_036b0e2d-319b-4b26-a6c1-676f9952948fdevice_6842c230-5152-40b4-8477-b9f4c12ae85fdevice_398c99f5-0838-4dfc-a76c-5b881c56d32edevice_9fbdc770-4d52-4eca-8671-76e435bb50e8=VmId=e5a192f1-3f9d-48e1-a817-28f72815c646,DeviceId=9fbdc770-4d52-4eca-8671-76e435bb50e8,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0} >2012-08-07 14:30:05,653 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [4fd46f1b] FINISH, CreateVDSCommand, log id: 339d83ea >2012-08-07 14:30:05,677 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [4fd46f1b] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 1. Vm: pool1-12 >2012-08-07 14:30:05,741 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [4fd46f1b] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 5f797275 >2012-08-07 14:30:05,742 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [4fd46f1b] Lock freed to object EngineLock [exclusiveLocks= key: e5a192f1-3f9d-48e1-a817-28f72815c646 value: VM >, sharedLocks= ] >2012-08-07 14:30:05,886 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [7dfa94d] Running command: RunVmCommand internal: false. Entities affected : ID: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 Type: VM >2012-08-07 14:30:05,953 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [7dfa94d] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5, vm=org.ovirt.engine.core.common.businessentities.VM@1b6f1756), log id: 3238804c >2012-08-07 14:30:05,969 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [7dfa94d] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5, vm=org.ovirt.engine.core.common.businessentities.VM@1b6f1756), log id: 7243f982 >2012-08-07 14:30:06,065 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [7dfa94d] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5,devices=[Ljava.util.Map;@412ac8e4,acpiEnable=true,vmName=pool1-8,cpuType=Conroe,custom={} >2012-08-07 14:30:06,067 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [7dfa94d] FINISH, CreateVDSCommand, log id: 7243f982 >2012-08-07 14:30:06,073 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [7dfa94d] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 2. Vm: pool1-8 >2012-08-07 14:30:06,143 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [7dfa94d] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 3238804c >2012-08-07 14:30:06,144 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [7dfa94d] Lock freed to object EngineLock [exclusiveLocks= key: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 value: VM >, sharedLocks= ] >2012-08-07 14:30:06,258 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [662c6e93] Running command: RunVmCommand internal: false. Entities affected : ID: 5524b98a-aa45-49cb-9d8b-bec3884753c9 Type: VM >2012-08-07 14:30:06,312 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [662c6e93] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=5524b98a-aa45-49cb-9d8b-bec3884753c9, vm=org.ovirt.engine.core.common.businessentities.VM@37466472), log id: 21a09b95 >2012-08-07 14:30:06,358 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-78) START, FullListVdsCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=null, vmIds=[96405d4a-a3bd-4900-ab90-9c8736cb02a5, e5a192f1-3f9d-48e1-a817-28f72815c646]), log id: 37ef45b4 >2012-08-07 14:30:06,401 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-78) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@3dc9491c, log id: 37ef45b4 >2012-08-07 14:30:06,427 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-78) Recieved a Device without an address when processing VM 96405d4a-a3bd-4900-ab90-9c8736cb02a5 devices, skipping device: {specParams={}, device=ich6, type=sound, deviceId=df3d49c5-fba4-4a13-97df-4856feeef810}. >2012-08-07 14:30:06,431 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-78) Recieved a Device without an address when processing VM 96405d4a-a3bd-4900-ab90-9c8736cb02a5 devices, skipping device: {specParams={vram=65536}, device=qxl, type=video, deviceId=041230c8-a2cf-4e94-b024-241742fdddc5}. >2012-08-07 14:30:06,432 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-78) Recieved a Device without an address when processing VM 96405d4a-a3bd-4900-ab90-9c8736cb02a5 devices, skipping device: {nicModel=pv, specParams={}, device=bridge, macAddr=00:1a:4a:23:61:5f, type=interface, deviceId=7d96ff95-52c0-4a0e-9a89-a8ce9506e969, network=rhevm}. >2012-08-07 14:30:06,433 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-78) Recieved a Device without an address when processing VM 96405d4a-a3bd-4900-ab90-9c8736cb02a5 devices, skipping device: {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=f2bc0458-ac4c-4e9d-8cde-2864b1388db4}. >2012-08-07 14:30:06,438 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-78) Recieved a Device without an address when processing VM 96405d4a-a3bd-4900-ab90-9c8736cb02a5 devices, skipping device: {shared=false, iface=ide, index=2, specParams={path=}, device=cdrom, path=, type=disk, readonly=true, deviceId=93e87184-b2cb-4336-befd-ff99387d0cc6}. >2012-08-07 14:30:06,439 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-78) Recieved a Device without an address when processing VM 96405d4a-a3bd-4900-ab90-9c8736cb02a5 devices, skipping device: {shared=false, volumeID=4e72a178-3a33-462e-97c1-b9d3830bfc04, index=0, propagateErrors=off, format=cow, type=disk, truesize=139264, reqsize=0, bootOrder=1, iface=virtio, volumeChain=[Ljava.lang.Object;@52c112b1, imageID=4a2ba0e7-a428-4859-bac7-c48b69233e60, domainID=a9af3dac-1730-4ec8-8d7f-0507cee4aa1a, specParams={}, optional=false, needExtend=false, path=/rhev/data-center/efe20197-e0a7-49b8-beb4-19b1ed3f8c3f/a9af3dac-1730-4ec8-8d7f-0507cee4aa1a/images/4a2ba0e7-a428-4859-bac7-c48b69233e60/4e72a178-3a33-462e-97c1-b9d3830bfc04, device=disk, poolID=efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, readonly=false, apparentsize=262144, deviceId=4a2ba0e7-a428-4859-bac7-c48b69233e60}. >2012-08-07 14:30:06,449 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-78) VM 96405d4a-a3bd-4900-ab90-9c8736cb02a5 managed non plugable device was removed unexpetedly from libvirt: VmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5,DeviceId=041230c8-a2cf-4e94-b024-241742fdddc5,Device=qxl,Type=video,BootOrder=0,SpecParams={vram=65536},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=false,alias= >2012-08-07 14:30:06,453 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-78) VM 96405d4a-a3bd-4900-ab90-9c8736cb02a5 managed non plugable device was removed unexpetedly from libvirt: VmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5,DeviceId=f2bc0458-ac4c-4e9d-8cde-2864b1388db4,Device=memballoon,Type=balloon,BootOrder=0,SpecParams={model=virtio},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=true,alias= >2012-08-07 14:30:06,454 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-78) VM 96405d4a-a3bd-4900-ab90-9c8736cb02a5 managed non plugable device was removed unexpetedly from libvirt: VmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5,DeviceId=7d96ff95-52c0-4a0e-9a89-a8ce9506e969,Device=bridge,Type=interface,BootOrder=0,SpecParams={},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=false,alias= >2012-08-07 14:30:06,456 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-78) VM 96405d4a-a3bd-4900-ab90-9c8736cb02a5 managed non plugable device was removed unexpetedly from libvirt: VmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5,DeviceId=4a2ba0e7-a428-4859-bac7-c48b69233e60,Device=disk,Type=disk,BootOrder=1,SpecParams={},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=false,alias= >2012-08-07 14:30:06,457 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-78) VM 96405d4a-a3bd-4900-ab90-9c8736cb02a5 managed non plugable device was removed unexpetedly from libvirt: VmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5,DeviceId=93e87184-b2cb-4336-befd-ff99387d0cc6,Device=cdrom,Type=disk,BootOrder=0,SpecParams={path=},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=true,alias= >2012-08-07 14:30:06,458 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-78) VM 96405d4a-a3bd-4900-ab90-9c8736cb02a5 managed non plugable device was removed unexpetedly from libvirt: VmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5,DeviceId=df3d49c5-fba4-4a13-97df-4856feeef810,Device=ich6,Type=sound,BootOrder=0,SpecParams={},Address=,IsManaged=true,IsPlugged=true,IsReadOnly=true,alias= >2012-08-07 14:30:06,485 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-78) Recieved a Device without an address when processing VM e5a192f1-3f9d-48e1-a817-28f72815c646 devices, skipping device: {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=0a89761f-fc5c-40bc-846f-bfc2e189cecf}. >2012-08-07 14:30:06,495 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-78) VM e5a192f1-3f9d-48e1-a817-28f72815c646 managed non plugable device was removed unexpetedly from libvirt: VmId=e5a192f1-3f9d-48e1-a817-28f72815c646,DeviceId=0a89761f-fc5c-40bc-846f-bfc2e189cecf,Device=memballoon,Type=balloon,BootOrder=0,SpecParams={model=virtio},Address={bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0},IsManaged=true,IsPlugged=true,IsReadOnly=true,alias=balloon0 >2012-08-07 14:30:06,758 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [662c6e93] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=5524b98a-aa45-49cb-9d8b-bec3884753c9, vm=org.ovirt.engine.core.common.businessentities.VM@37466472), log id: 16888f3e >2012-08-07 14:30:07,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [662c6e93] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=5524b98a-aa45-49cb-9d8b-bec3884753c9,devices=[Ljava.util.Map;@22b5439a,acpiEnable=true,vmName=pool1-15,cpuType=Conroe,custom={} >2012-08-07 14:30:07,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [662c6e93] FINISH, CreateVDSCommand, log id: 16888f3e >2012-08-07 14:30:07,027 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [662c6e93] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 3. Vm: pool1-15 >2012-08-07 14:30:07,057 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [662c6e93] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 21a09b95 >2012-08-07 14:30:07,058 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [662c6e93] Lock freed to object EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] >2012-08-07 14:30:07,141 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [14d4bc40] Running command: RunVmCommand internal: false. Entities affected : ID: c1cb365c-a119-493c-964c-faf65a10c889 Type: VM >2012-08-07 14:30:07,178 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [14d4bc40] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=c1cb365c-a119-493c-964c-faf65a10c889, vm=org.ovirt.engine.core.common.businessentities.VM@b54b546), log id: 34239238 >2012-08-07 14:30:07,182 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [14d4bc40] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=c1cb365c-a119-493c-964c-faf65a10c889, vm=org.ovirt.engine.core.common.businessentities.VM@b54b546), log id: 70bee37e >2012-08-07 14:30:07,283 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [14d4bc40] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=c1cb365c-a119-493c-964c-faf65a10c889,devices=[Ljava.util.Map;@37b6269f,acpiEnable=true,vmName=pool1-5,cpuType=Conroe,custom={device_58f19f9a-b63b-4b20-8f27-e9356cd5bca4device_cea28ce3-519f-418f-be81-d15f49007a0cdevice_580a7f36-920f-446b-9641-f264d1592d6fdevice_56595eb6-d869-48ce-a282-61d03bea8008=VmId=c1cb365c-a119-493c-964c-faf65a10c889,DeviceId=56595eb6-d869-48ce-a282-61d03bea8008,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_58f19f9a-b63b-4b20-8f27-e9356cd5bca4device_cea28ce3-519f-418f-be81-d15f49007a0c=VmId=c1cb365c-a119-493c-964c-faf65a10c889,DeviceId=cea28ce3-519f-418f-be81-d15f49007a0c,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_58f19f9a-b63b-4b20-8f27-e9356cd5bca4device_cea28ce3-519f-418f-be81-d15f49007a0cdevice_580a7f36-920f-446b-9641-f264d1592d6f=VmId=c1cb365c-a119-493c-964c-faf65a10c889,DeviceId=580a7f36-920f-446b-9641-f264d1592d6f,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_58f19f9a-b63b-4b20-8f27-e9356cd5bca4device_cea28ce3-519f-418f-be81-d15f49007a0cdevice_580a7f36-920f-446b-9641-f264d1592d6fdevice_56595eb6-d869-48ce-a282-61d03bea8008device_604dc6d3-baec-486b-9b94-3198197e8af6=VmId=c1cb365c-a119-493c-964c-faf65a10c889,DeviceId=604dc6d3-baec-486b-9b94-3198197e8af6,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_58f19f9a-b63b-4b20-8f27-e9356cd5bca4=VmId=c1cb365c-a119-493c-964c-faf65a10c889,DeviceId=58f19f9a-b63b-4b20-8f27-e9356cd5bca4,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0} >2012-08-07 14:30:07,289 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [14d4bc40] FINISH, CreateVDSCommand, log id: 70bee37e >2012-08-07 14:30:07,295 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [14d4bc40] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 4. Vm: pool1-5 >2012-08-07 14:30:07,334 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [14d4bc40] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 34239238 >2012-08-07 14:30:07,335 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [14d4bc40] Lock freed to object EngineLock [exclusiveLocks= key: c1cb365c-a119-493c-964c-faf65a10c889 value: VM >, sharedLocks= ] >2012-08-07 14:30:07,503 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [3661788] Running command: RunVmCommand internal: false. Entities affected : ID: c7702cf0-88da-4885-9b9c-9e59772b3774 Type: VM >2012-08-07 14:30:07,594 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [3661788] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=c7702cf0-88da-4885-9b9c-9e59772b3774, vm=org.ovirt.engine.core.common.businessentities.VM@64ea87eb), log id: 6ab06d95 >2012-08-07 14:30:07,610 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [3661788] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=c7702cf0-88da-4885-9b9c-9e59772b3774, vm=org.ovirt.engine.core.common.businessentities.VM@64ea87eb), log id: 3289e7ee >2012-08-07 14:30:07,728 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [3661788] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=c7702cf0-88da-4885-9b9c-9e59772b3774,devices=[Ljava.util.Map;@6bbf68cf,acpiEnable=true,vmName=pool1-6,cpuType=Conroe,custom={device_a4c7aa56-9bc1-44c7-be30-f134dd9314ecdevice_d9468940-7503-48c8-b782-1199cf9ca83d=VmId=c7702cf0-88da-4885-9b9c-9e59772b3774,DeviceId=d9468940-7503-48c8-b782-1199cf9ca83d,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_a4c7aa56-9bc1-44c7-be30-f134dd9314ecdevice_d9468940-7503-48c8-b782-1199cf9ca83ddevice_dd9a8c43-31aa-4d83-a643-9d79440938f8device_0c34ed15-d3fe-421d-8797-f1de927bbb29=VmId=c7702cf0-88da-4885-9b9c-9e59772b3774,DeviceId=0c34ed15-d3fe-421d-8797-f1de927bbb29,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_a4c7aa56-9bc1-44c7-be30-f134dd9314ec=VmId=c7702cf0-88da-4885-9b9c-9e59772b3774,DeviceId=a4c7aa56-9bc1-44c7-be30-f134dd9314ec,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_a4c7aa56-9bc1-44c7-be30-f134dd9314ecdevice_d9468940-7503-48c8-b782-1199cf9ca83ddevice_dd9a8c43-31aa-4d83-a643-9d79440938f8device_0c34ed15-d3fe-421d-8797-f1de927bbb29device_2544ee86-d5bb-47c7-a456-1fc94cf85d3f=VmId=c7702cf0-88da-4885-9b9c-9e59772b3774,DeviceId=2544ee86-d5bb-47c7-a456-1fc94cf85d3f,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_a4c7aa56-9bc1-44c7-be30-f134dd9314ecdevice_d9468940-7503-48c8-b782-1199cf9ca83ddevice_dd9a8c43-31aa-4d83-a643-9d79440938f8=VmId=c7702cf0-88da-4885-9b9c-9e59772b3774,DeviceId=dd9a8c43-31aa-4d83-a643-9d79440938f8,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0} >2012-08-07 14:30:07,734 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [3661788] FINISH, CreateVDSCommand, log id: 3289e7ee >2012-08-07 14:30:07,741 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [3661788] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 5. Vm: pool1-6 >2012-08-07 14:30:07,798 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [3661788] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 6ab06d95 >2012-08-07 14:30:07,799 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [3661788] Lock freed to object EngineLock [exclusiveLocks= key: c7702cf0-88da-4885-9b9c-9e59772b3774 value: VM >, sharedLocks= ] >2012-08-07 14:30:07,889 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [6c6078b3] Running command: RunVmCommand internal: false. Entities affected : ID: 3ce0f220-6cb8-42d8-b922-7003c60ccdad Type: VM >2012-08-07 14:30:07,913 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [6c6078b3] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad, vm=org.ovirt.engine.core.common.businessentities.VM@413d690b), log id: 36bd3a48 >2012-08-07 14:30:07,917 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [6c6078b3] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad, vm=org.ovirt.engine.core.common.businessentities.VM@413d690b), log id: 3a2374d7 >2012-08-07 14:30:08,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [6c6078b3] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad,devices=[Ljava.util.Map;@6f2f0d9e,acpiEnable=true,vmName=pool1-7,cpuType=Conroe,custom={device_1c1efb05-d7c7-4758-b92d-c6d3c872a94edevice_26d97542-58cc-4e58-a670-b0abb4a84958=VmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad,DeviceId=26d97542-58cc-4e58-a670-b0abb4a84958,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_1c1efb05-d7c7-4758-b92d-c6d3c872a94edevice_26d97542-58cc-4e58-a670-b0abb4a84958device_cfdcf61e-ad4e-4340-963e-ca9930b4034cdevice_afdcd308-4798-4988-804b-54a042217771device_bb0dca68-021c-4ff8-afdc-d8669f3af26c=VmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad,DeviceId=bb0dca68-021c-4ff8-afdc-d8669f3af26c,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_1c1efb05-d7c7-4758-b92d-c6d3c872a94e=VmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad,DeviceId=1c1efb05-d7c7-4758-b92d-c6d3c872a94e,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_1c1efb05-d7c7-4758-b92d-c6d3c872a94edevice_26d97542-58cc-4e58-a670-b0abb4a84958device_cfdcf61e-ad4e-4340-963e-ca9930b4034c=VmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad,DeviceId=cfdcf61e-ad4e-4340-963e-ca9930b4034c,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_1c1efb05-d7c7-4758-b92d-c6d3c872a94edevice_26d97542-58cc-4e58-a670-b0abb4a84958device_cfdcf61e-ad4e-4340-963e-ca9930b4034cdevice_afdcd308-4798-4988-804b-54a042217771=VmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad,DeviceId=afdcd308-4798-4988-804b-54a042217771,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0} >2012-08-07 14:30:08,029 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [6c6078b3] FINISH, CreateVDSCommand, log id: 3a2374d7 >2012-08-07 14:30:08,034 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [6c6078b3] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 6. Vm: pool1-7 >2012-08-07 14:30:08,089 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [6c6078b3] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 36bd3a48 >2012-08-07 14:30:08,089 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [6c6078b3] Lock freed to object EngineLock [exclusiveLocks= key: 3ce0f220-6cb8-42d8-b922-7003c60ccdad value: VM >, sharedLocks= ] >2012-08-07 14:30:08,156 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [77c3c960] Running command: RunVmCommand internal: false. Entities affected : ID: 6df57989-99a7-4ec9-8f7c-15f222064e61 Type: VM >2012-08-07 14:30:08,188 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [77c3c960] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6df57989-99a7-4ec9-8f7c-15f222064e61, vm=org.ovirt.engine.core.common.businessentities.VM@6d352347), log id: 24e763f >2012-08-07 14:30:08,192 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [77c3c960] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6df57989-99a7-4ec9-8f7c-15f222064e61, vm=org.ovirt.engine.core.common.businessentities.VM@6d352347), log id: 2e180ee8 >2012-08-07 14:30:08,303 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [77c3c960] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=6df57989-99a7-4ec9-8f7c-15f222064e61,devices=[Ljava.util.Map;@8d733f1,acpiEnable=true,vmName=pool1-2,cpuType=Conroe,custom={device_95ff5d5c-d403-4c15-8ce8-74a01e88bf04device_9514fd8e-6934-48a9-ac0c-e40c7662681fdevice_b07152e3-af44-46ae-8abe-c5f8aa0951d1device_1eff0f5f-41e9-482d-8f03-7dd20ea6afd8=VmId=6df57989-99a7-4ec9-8f7c-15f222064e61,DeviceId=1eff0f5f-41e9-482d-8f03-7dd20ea6afd8,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_95ff5d5c-d403-4c15-8ce8-74a01e88bf04device_9514fd8e-6934-48a9-ac0c-e40c7662681fdevice_b07152e3-af44-46ae-8abe-c5f8aa0951d1=VmId=6df57989-99a7-4ec9-8f7c-15f222064e61,DeviceId=b07152e3-af44-46ae-8abe-c5f8aa0951d1,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_95ff5d5c-d403-4c15-8ce8-74a01e88bf04device_9514fd8e-6934-48a9-ac0c-e40c7662681fdevice_b07152e3-af44-46ae-8abe-c5f8aa0951d1device_1eff0f5f-41e9-482d-8f03-7dd20ea6afd8device_91a42171-0b7c-4225-9ebb-d41b4258e49b=VmId=6df57989-99a7-4ec9-8f7c-15f222064e61,DeviceId=91a42171-0b7c-4225-9ebb-d41b4258e49b,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_95ff5d5c-d403-4c15-8ce8-74a01e88bf04=VmId=6df57989-99a7-4ec9-8f7c-15f222064e61,DeviceId=95ff5d5c-d403-4c15-8ce8-74a01e88bf04,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_95ff5d5c-d403-4c15-8ce8-74a01e88bf04device_9514fd8e-6934-48a9-ac0c-e40c7662681f=VmId=6df57989-99a7-4ec9-8f7c-15f222064e61,DeviceId=9514fd8e-6934-48a9-ac0c-e40c7662681f,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0} >2012-08-07 14:30:08,312 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [77c3c960] FINISH, CreateVDSCommand, log id: 2e180ee8 >2012-08-07 14:30:08,322 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [77c3c960] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 7. Vm: pool1-2 >2012-08-07 14:30:08,363 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [77c3c960] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 24e763f >2012-08-07 14:30:08,364 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [77c3c960] Lock freed to object EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-07 14:30:08,442 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [267a8df8] Running command: RunVmCommand internal: false. Entities affected : ID: d3c805a2-419c-480f-8627-f5c9ef5c4117 Type: VM >2012-08-07 14:30:08,468 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [267a8df8] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=d3c805a2-419c-480f-8627-f5c9ef5c4117, vm=org.ovirt.engine.core.common.businessentities.VM@6a42a14), log id: 714f331a >2012-08-07 14:30:08,472 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [267a8df8] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=d3c805a2-419c-480f-8627-f5c9ef5c4117, vm=org.ovirt.engine.core.common.businessentities.VM@6a42a14), log id: 570e19b1 >2012-08-07 14:30:08,573 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [267a8df8] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=d3c805a2-419c-480f-8627-f5c9ef5c4117,devices=[Ljava.util.Map;@6034ebc8,acpiEnable=true,vmName=pool1-3,cpuType=Conroe,custom={device_9313a716-f457-4cf6-ac99-1d69ac546ee5=VmId=d3c805a2-419c-480f-8627-f5c9ef5c4117,DeviceId=9313a716-f457-4cf6-ac99-1d69ac546ee5,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_9313a716-f457-4cf6-ac99-1d69ac546ee5device_b947cc6c-4bec-4a5e-ad0e-223c41a7ea76device_d1fa0f1e-1fff-4225-b650-85dff4e80480device_5c8f04e7-f3f3-4920-b771-e29abc340e1b=VmId=d3c805a2-419c-480f-8627-f5c9ef5c4117,DeviceId=5c8f04e7-f3f3-4920-b771-e29abc340e1b,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_9313a716-f457-4cf6-ac99-1d69ac546ee5device_b947cc6c-4bec-4a5e-ad0e-223c41a7ea76=VmId=d3c805a2-419c-480f-8627-f5c9ef5c4117,DeviceId=b947cc6c-4bec-4a5e-ad0e-223c41a7ea76,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_9313a716-f457-4cf6-ac99-1d69ac546ee5device_b947cc6c-4bec-4a5e-ad0e-223c41a7ea76device_d1fa0f1e-1fff-4225-b650-85dff4e80480=VmId=d3c805a2-419c-480f-8627-f5c9ef5c4117,DeviceId=d1fa0f1e-1fff-4225-b650-85dff4e80480,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_9313a716-f457-4cf6-ac99-1d69ac546ee5device_b947cc6c-4bec-4a5e-ad0e-223c41a7ea76device_d1fa0f1e-1fff-4225-b650-85dff4e80480device_5c8f04e7-f3f3-4920-b771-e29abc340e1bdevice_02e9de12-034f-44e5-a25d-45bfc0b1201d=VmId=d3c805a2-419c-480f-8627-f5c9ef5c4117,DeviceId=02e9de12-034f-44e5-a25d-45bfc0b1201d,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1} >2012-08-07 14:30:08,580 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-42) [267a8df8] FINISH, CreateVDSCommand, log id: 570e19b1 >2012-08-07 14:30:08,586 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [267a8df8] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 8. Vm: pool1-3 >2012-08-07 14:30:08,639 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-42) [267a8df8] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 714f331a >2012-08-07 14:30:08,640 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [267a8df8] Lock freed to object EngineLock [exclusiveLocks= key: d3c805a2-419c-480f-8627-f5c9ef5c4117 value: VM >, sharedLocks= ] >2012-08-07 14:30:08,722 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [5bebd1e5] Running command: RunVmCommand internal: false. Entities affected : ID: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 Type: VM >2012-08-07 14:30:08,732 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [5bebd1e5] Cant find VDS to run the VM a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 on, so this VM will not be run. >2012-08-07 14:30:08,779 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [5bebd1e5] Lock freed to object EngineLock [exclusiveLocks= key: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 value: VM >, sharedLocks= ] >2012-08-07 14:30:08,865 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-88) VM pool1-8 96405d4a-a3bd-4900-ab90-9c8736cb02a5 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:30:08,866 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-88) VM pool1-12 e5a192f1-3f9d-48e1-a817-28f72815c646 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:30:08,871 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-88) START, FullListVdsCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=null, vmIds=[96405d4a-a3bd-4900-ab90-9c8736cb02a5, e5a192f1-3f9d-48e1-a817-28f72815c646]), log id: 13945b51 >2012-08-07 14:30:08,906 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-88) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@246de5a5, log id: 13945b51 >2012-08-07 14:30:08,934 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [2614cd2e] Running command: RunVmCommand internal: false. Entities affected : ID: 3c7c0453-5f05-4314-bdd4-eb4fd243f80a Type: VM >2012-08-07 14:30:08,956 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [2614cd2e] Cant find VDS to run the VM 3c7c0453-5f05-4314-bdd4-eb4fd243f80a on, so this VM will not be run. >2012-08-07 14:30:08,976 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [2614cd2e] Lock freed to object EngineLock [exclusiveLocks= key: 3c7c0453-5f05-4314-bdd4-eb4fd243f80a value: VM >, sharedLocks= ] >2012-08-07 14:30:09,126 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [598ba147] Running command: RunVmCommand internal: false. Entities affected : ID: 6c1fcddf-86d6-4533-905b-abb11b775f5b Type: VM >2012-08-07 14:30:09,156 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [598ba147] Cant find VDS to run the VM 6c1fcddf-86d6-4533-905b-abb11b775f5b on, so this VM will not be run. >2012-08-07 14:30:09,182 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [598ba147] Lock freed to object EngineLock [exclusiveLocks= key: 6c1fcddf-86d6-4533-905b-abb11b775f5b value: VM >, sharedLocks= ] >2012-08-07 14:30:09,312 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [43b32c34] Running command: RunVmCommand internal: false. Entities affected : ID: 2842672f-6230-434f-8232-e88e71560092 Type: VM >2012-08-07 14:30:09,325 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [43b32c34] Cant find VDS to run the VM 2842672f-6230-434f-8232-e88e71560092 on, so this VM will not be run. >2012-08-07 14:30:09,351 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [43b32c34] Lock freed to object EngineLock [exclusiveLocks= key: 2842672f-6230-434f-8232-e88e71560092 value: VM >, sharedLocks= ] >2012-08-07 14:30:09,470 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [157bdc48] Running command: RunVmCommand internal: false. Entities affected : ID: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 Type: VM >2012-08-07 14:30:09,478 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [157bdc48] Cant find VDS to run the VM 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 on, so this VM will not be run. >2012-08-07 14:30:09,510 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [157bdc48] Lock freed to object EngineLock [exclusiveLocks= key: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 value: VM >, sharedLocks= ] >2012-08-07 14:30:09,648 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [fe70fde] Running command: RunVmCommand internal: false. Entities affected : ID: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 Type: VM >2012-08-07 14:30:09,657 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [fe70fde] Cant find VDS to run the VM 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 on, so this VM will not be run. >2012-08-07 14:30:09,683 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) [fe70fde] Lock freed to object EngineLock [exclusiveLocks= key: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 value: VM >, sharedLocks= ] >2012-08-07 14:30:11,276 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-100) VM pool1-15 5524b98a-aa45-49cb-9d8b-bec3884753c9 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:30:11,277 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-100) VM pool1-6 c7702cf0-88da-4885-9b9c-9e59772b3774 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:30:11,277 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-100) VM pool1-7 3ce0f220-6cb8-42d8-b922-7003c60ccdad moved from WaitForLaunch --> PoweringUp >2012-08-07 14:30:11,278 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-100) VM pool1-5 c1cb365c-a119-493c-964c-faf65a10c889 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:30:11,279 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-100) START, FullListVdsCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=null, vmIds=[5524b98a-aa45-49cb-9d8b-bec3884753c9, c7702cf0-88da-4885-9b9c-9e59772b3774, 3ce0f220-6cb8-42d8-b922-7003c60ccdad, c1cb365c-a119-493c-964c-faf65a10c889]), log id: 6f709a7b >2012-08-07 14:30:11,313 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-100) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@49ae3a65, log id: 6f709a7b >2012-08-07 14:30:13,882 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-1) VM pool1-3 d3c805a2-419c-480f-8627-f5c9ef5c4117 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:30:13,882 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-1) VM pool1-2 6df57989-99a7-4ec9-8f7c-15f222064e61 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:30:13,883 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-1) START, FullListVdsCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=null, vmIds=[d3c805a2-419c-480f-8627-f5c9ef5c4117, 6df57989-99a7-4ec9-8f7c-15f222064e61]), log id: 11ea381f >2012-08-07 14:30:13,909 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-1) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@280a8469, log id: 11ea381f >2012-08-07 14:31:06,866 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-97) VM pool1-8 96405d4a-a3bd-4900-ab90-9c8736cb02a5 moved from PoweringUp --> Up >2012-08-07 14:31:06,867 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-97) VM pool1-12 e5a192f1-3f9d-48e1-a817-28f72815c646 moved from PoweringUp --> Up >2012-08-07 14:31:06,887 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-97) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@3eb715e), log id: 18bf4f67 >2012-08-07 14:31:06,902 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-97) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 18bf4f67 >2012-08-07 14:31:06,937 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-97) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@6b85117f), log id: 68ff2435 >2012-08-07 14:31:06,955 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-97) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 68ff2435 >2012-08-07 14:31:09,159 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-95) VM pool1-15 5524b98a-aa45-49cb-9d8b-bec3884753c9 moved from PoweringUp --> Up >2012-08-07 14:31:09,159 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-95) VM pool1-6 c7702cf0-88da-4885-9b9c-9e59772b3774 moved from PoweringUp --> Up >2012-08-07 14:31:09,160 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-95) VM pool1-3 d3c805a2-419c-480f-8627-f5c9ef5c4117 moved from PoweringUp --> Up >2012-08-07 14:31:09,161 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-95) VM pool1-7 3ce0f220-6cb8-42d8-b922-7003c60ccdad moved from PoweringUp --> Up >2012-08-07 14:31:09,161 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-95) VM pool1-2 6df57989-99a7-4ec9-8f7c-15f222064e61 moved from PoweringUp --> Up >2012-08-07 14:31:09,162 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-95) VM pool1-5 c1cb365c-a119-493c-964c-faf65a10c889 moved from PoweringUp --> Up >2012-08-07 14:31:09,193 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-95) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@d31eb1a0), log id: 19710660 >2012-08-07 14:31:09,205 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-95) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 19710660 >2012-08-07 14:31:09,241 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-95) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@3ab851c1), log id: 2ba62910 >2012-08-07 14:31:09,252 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-95) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 2ba62910 >2012-08-07 14:31:09,278 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-95) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@a251f1e2), log id: 7df559bd >2012-08-07 14:31:09,311 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-95) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 7df559bd >2012-08-07 14:31:09,402 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-95) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@9eb9203), log id: 135526c7 >2012-08-07 14:31:09,435 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-95) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 135526c7 >2012-08-07 14:31:09,466 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-95) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@71853224), log id: 44d0801d >2012-08-07 14:31:09,478 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-95) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 44d0801d >2012-08-07 14:31:09,505 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-95) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@d91ed245), log id: 11ea66d9 >2012-08-07 14:31:09,520 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-95) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 11ea66d9 >2012-08-07 14:32:17,392 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/7/12 2:32 PM. Start running CanDoAction for command number 1/3 (Command type: StopVm) >2012-08-07 14:32:17,395 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) Start time: 8/7/12 2:32 PM. Start running CanDoAction for command number 2/3 (Command type: StopVm) >2012-08-07 14:32:17,403 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/7/12 2:32 PM. Start running CanDoAction for command number 3/3 (Command type: StopVm) >2012-08-07 14:32:17,417 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) End time: 8/7/12 2:32 PM. Finish handling CanDoAction for command number 2/3 (Command type: StopVm) >2012-08-07 14:32:17,425 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/7/12 2:32 PM. Finish handling CanDoAction for command number 1/3 (Command type: StopVm) >2012-08-07 14:32:17,452 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/7/12 2:32 PM. Finish handling CanDoAction for command number 3/3 (Command type: StopVm) >2012-08-07 14:32:17,540 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-43) [33800859] Running command: StopVmCommand internal: false. Entities affected : ID: 6df57989-99a7-4ec9-8f7c-15f222064e61 Type: VM >2012-08-07 14:32:17,542 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-43) [33800859] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6df57989-99a7-4ec9-8f7c-15f222064e61, force=false, secondsToWait=0, gracefully=false), log id: 447a36a2 >2012-08-07 14:32:17,548 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-43) [33800859] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6df57989-99a7-4ec9-8f7c-15f222064e61, force=false, secondsToWait=0, gracefully=false), log id: f665468 >2012-08-07 14:32:17,934 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-43) [33800859] FINISH, DestroyVDSCommand, log id: f665468 >2012-08-07 14:32:17,963 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-43) [33800859] FINISH, DestroyVmVDSCommand, return: Down, log id: 447a36a2 >2012-08-07 14:32:18,086 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-43) [1aa42579] Running command: StopVmCommand internal: false. Entities affected : ID: d3c805a2-419c-480f-8627-f5c9ef5c4117 Type: VM >2012-08-07 14:32:18,089 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-43) [1aa42579] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=d3c805a2-419c-480f-8627-f5c9ef5c4117, force=false, secondsToWait=0, gracefully=false), log id: 7f4f07ac >2012-08-07 14:32:18,212 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-43) [1aa42579] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=d3c805a2-419c-480f-8627-f5c9ef5c4117, force=false, secondsToWait=0, gracefully=false), log id: 3d712e0b >2012-08-07 14:32:18,581 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-43) [1aa42579] FINISH, DestroyVDSCommand, log id: 3d712e0b >2012-08-07 14:32:18,654 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-43) [1aa42579] FINISH, DestroyVmVDSCommand, return: Down, log id: 7f4f07ac >2012-08-07 14:32:18,874 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-43) [e983899] Running command: StopVmCommand internal: false. Entities affected : ID: 5524b98a-aa45-49cb-9d8b-bec3884753c9 Type: VM >2012-08-07 14:32:18,877 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-43) [e983899] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=5524b98a-aa45-49cb-9d8b-bec3884753c9, force=false, secondsToWait=0, gracefully=false), log id: 58ce63d0 >2012-08-07 14:32:18,881 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-43) [e983899] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=5524b98a-aa45-49cb-9d8b-bec3884753c9, force=false, secondsToWait=0, gracefully=false), log id: 63e4f1c7 >2012-08-07 14:32:19,219 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-43) [e983899] FINISH, DestroyVDSCommand, log id: 63e4f1c7 >2012-08-07 14:32:19,246 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-43) [e983899] FINISH, DestroyVmVDSCommand, return: Down, log id: 58ce63d0 >2012-08-07 14:32:30,190 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/7/12 2:32 PM. Start running CanDoAction for command number 1/5 (Command type: StopVm) >2012-08-07 14:32:30,194 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/7/12 2:32 PM. Start running CanDoAction for command number 2/5 (Command type: StopVm) >2012-08-07 14:32:30,199 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) Start time: 8/7/12 2:32 PM. Start running CanDoAction for command number 3/5 (Command type: StopVm) >2012-08-07 14:32:30,205 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) Start time: 8/7/12 2:32 PM. Start running CanDoAction for command number 4/5 (Command type: StopVm) >2012-08-07 14:32:30,209 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/7/12 2:32 PM. Start running CanDoAction for command number 5/5 (Command type: StopVm) >2012-08-07 14:32:30,229 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/7/12 2:32 PM. Finish handling CanDoAction for command number 2/5 (Command type: StopVm) >2012-08-07 14:32:30,236 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/7/12 2:32 PM. Finish handling CanDoAction for command number 1/5 (Command type: StopVm) >2012-08-07 14:32:30,237 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/7/12 2:32 PM. Finish handling CanDoAction for command number 5/5 (Command type: StopVm) >2012-08-07 14:32:30,255 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) End time: 8/7/12 2:32 PM. Finish handling CanDoAction for command number 3/5 (Command type: StopVm) >2012-08-07 14:32:30,262 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) End time: 8/7/12 2:32 PM. Finish handling CanDoAction for command number 4/5 (Command type: StopVm) >2012-08-07 14:32:30,394 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-48) [50f33099] Running command: StopVmCommand internal: false. Entities affected : ID: c7702cf0-88da-4885-9b9c-9e59772b3774 Type: VM >2012-08-07 14:32:30,396 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-48) [50f33099] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=c7702cf0-88da-4885-9b9c-9e59772b3774, force=false, secondsToWait=0, gracefully=false), log id: 4e19e51b >2012-08-07 14:32:30,401 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-48) [50f33099] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=c7702cf0-88da-4885-9b9c-9e59772b3774, force=false, secondsToWait=0, gracefully=false), log id: aa7bec >2012-08-07 14:32:30,757 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-48) [50f33099] FINISH, DestroyVDSCommand, log id: aa7bec >2012-08-07 14:32:30,809 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-48) [50f33099] FINISH, DestroyVmVDSCommand, return: Down, log id: 4e19e51b >2012-08-07 14:32:30,936 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-48) [dfbb654] Running command: StopVmCommand internal: false. Entities affected : ID: 3ce0f220-6cb8-42d8-b922-7003c60ccdad Type: VM >2012-08-07 14:32:30,938 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-48) [dfbb654] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad, force=false, secondsToWait=0, gracefully=false), log id: 1e7f6d93 >2012-08-07 14:32:30,942 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-48) [dfbb654] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=3ce0f220-6cb8-42d8-b922-7003c60ccdad, force=false, secondsToWait=0, gracefully=false), log id: 4db7cd60 >2012-08-07 14:32:31,304 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-48) [dfbb654] FINISH, DestroyVDSCommand, log id: 4db7cd60 >2012-08-07 14:32:31,350 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-48) [dfbb654] FINISH, DestroyVmVDSCommand, return: Down, log id: 1e7f6d93 >2012-08-07 14:32:31,535 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-48) [87f4bf8] Running command: StopVmCommand internal: false. Entities affected : ID: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 Type: VM >2012-08-07 14:32:31,537 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-48) [87f4bf8] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5, force=false, secondsToWait=0, gracefully=false), log id: 5388d93c >2012-08-07 14:32:31,541 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-48) [87f4bf8] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5, force=false, secondsToWait=0, gracefully=false), log id: 20128b27 >2012-08-07 14:32:31,893 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-48) [87f4bf8] FINISH, DestroyVDSCommand, log id: 20128b27 >2012-08-07 14:32:31,920 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-48) [87f4bf8] FINISH, DestroyVmVDSCommand, return: Down, log id: 5388d93c >2012-08-07 14:32:32,120 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-48) [5d548b23] Running command: StopVmCommand internal: false. Entities affected : ID: 8738bb81-c73e-4a41-a24a-c4c49491c536 Type: VM >2012-08-07 14:32:32,122 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-48) [5d548b23] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=8738bb81-c73e-4a41-a24a-c4c49491c536, force=false, secondsToWait=0, gracefully=false), log id: 6e78c846 >2012-08-07 14:32:32,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-48) [5d548b23] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=8738bb81-c73e-4a41-a24a-c4c49491c536, force=false, secondsToWait=0, gracefully=false), log id: 5b8f2db6 >2012-08-07 14:32:32,487 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-48) [5d548b23] FINISH, DestroyVDSCommand, log id: 5b8f2db6 >2012-08-07 14:32:32,523 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-48) [5d548b23] FINISH, DestroyVmVDSCommand, return: Down, log id: 6e78c846 >2012-08-07 14:32:32,688 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-48) [597ad6b3] Running command: StopVmCommand internal: false. Entities affected : ID: c1cb365c-a119-493c-964c-faf65a10c889 Type: VM >2012-08-07 14:32:32,690 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-48) [597ad6b3] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=c1cb365c-a119-493c-964c-faf65a10c889, force=false, secondsToWait=0, gracefully=false), log id: 7c46488 >2012-08-07 14:32:32,694 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-48) [597ad6b3] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=c1cb365c-a119-493c-964c-faf65a10c889, force=false, secondsToWait=0, gracefully=false), log id: e06e642 >2012-08-07 14:32:33,060 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-48) [597ad6b3] FINISH, DestroyVDSCommand, log id: e06e642 >2012-08-07 14:32:33,119 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-48) [597ad6b3] FINISH, DestroyVmVDSCommand, return: Down, log id: 7c46488 >2012-08-07 14:33:00,189 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [707b1ff5] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 14:33:00,190 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [707b1ff5] FINISH, ConnectStorageServerVDSCommand, log id: 29a1f0 >2012-08-07 14:33:00,191 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [707b1ff5] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 14:33:00,206 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-67) [707b1ff5] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:33 PM >2012-08-07 14:33:00,207 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-67) [707b1ff5] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 3e7f990a >2012-08-07 14:33:00,471 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-67) [707b1ff5] Failed in ActivateStorageDomainVDS method >2012-08-07 14:33:00,471 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-67) [707b1ff5] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:33:00,472 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-67) [707b1ff5] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:33:00,473 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-67) [707b1ff5] ERROR, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), exception: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',), log id: 3e7f990a: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.createException(BrokerCommandBase.java:201) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.ProceedProxyReturnValue(BrokerCommandBase.java:185) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand.ExecuteIrsBrokerCommand(ActivateStorageDomainVDSCommand.java:18) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand.ExecuteVDSCommand(IrsBrokerCommand.java:1520) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.ExecuteCommand(VDSCommandBase.java:60) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.Execute(VdcCommandBase.java:41) [engine-dal.jar:] > at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:390) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand.executeCommand(ActivateStorageDomainCommand.java:67) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteWithoutTransaction(CommandBase.java:810) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:901) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1256) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:168) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:107) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.Execute(CommandBase.java:916) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteAction(CommandBase.java:275) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:335) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:288) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.check(AutoRecoveryManager.java:96) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.onTimer(AutoRecoveryManager.java:63) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:64) [engine-scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz-2.1.2.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz-2.1.2.jar:] > >2012-08-07 14:33:00,498 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-67) [707b1ff5] FINISH, ActivateStorageDomainVDSCommand, log id: 3e7f990a >2012-08-07 14:33:00,499 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-67) [707b1ff5] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:33:00,506 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-67) [707b1ff5] Command [id=d5a38564-813c-477b-829b-18299562b8de]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 14:33:00,524 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) [707b1ff5] Checking autorecoverable storage domains done >2012-08-07 14:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts >2012-08-07 14:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering 0 hosts >2012-08-07 14:35:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts done >2012-08-07 14:35:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable storage domains >2012-08-07 14:35:00,089 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering 1 storage domains >2012-08-07 14:35:00,089 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 14:35:00,091 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [547a6f66] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:35:00,166 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [547a6f66] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 14:35:00,239 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [547a6f66] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:35:00,240 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [547a6f66] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:35 PM >2012-08-07 14:35:00,284 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-42) [547a6f66] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 18d3a697 >2012-08-07 14:38:00,288 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-42) [547a6f66] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 14:38:00,289 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-42) [547a6f66] FINISH, ConnectStorageServerVDSCommand, log id: 18d3a697 >2012-08-07 14:38:00,289 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-42) [547a6f66] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 14:38:00,305 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [547a6f66] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:38 PM >2012-08-07 14:38:00,306 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-9) [547a6f66] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 1a6f22e4 >2012-08-07 14:38:00,573 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-9) [547a6f66] Failed in ActivateStorageDomainVDS method >2012-08-07 14:38:00,573 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-9) [547a6f66] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:38:00,574 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-9) [547a6f66] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:38:00,575 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-9) [547a6f66] ERROR, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), exception: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',), log id: 1a6f22e4: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.createException(BrokerCommandBase.java:201) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.ProceedProxyReturnValue(BrokerCommandBase.java:185) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand.ExecuteIrsBrokerCommand(ActivateStorageDomainVDSCommand.java:18) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand.ExecuteVDSCommand(IrsBrokerCommand.java:1520) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.ExecuteCommand(VDSCommandBase.java:60) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.Execute(VdcCommandBase.java:41) [engine-dal.jar:] > at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:390) [engine-vdsbroker.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand.executeCommand(ActivateStorageDomainCommand.java:67) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteWithoutTransaction(CommandBase.java:810) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:901) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1256) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:168) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:107) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.Execute(CommandBase.java:916) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteAction(CommandBase.java:275) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:335) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:288) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.check(AutoRecoveryManager.java:96) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.onTimer(AutoRecoveryManager.java:63) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:64) [engine-scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz-2.1.2.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz-2.1.2.jar:] > >2012-08-07 14:38:00,600 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-9) [547a6f66] FINISH, ActivateStorageDomainVDSCommand, log id: 1a6f22e4 >2012-08-07 14:38:00,601 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [547a6f66] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:38:00,610 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-9) [547a6f66] Command [id=5d13fe84-7cea-42d5-ba88-af4e871194c2]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 14:38:00,637 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) [547a6f66] Checking autorecoverable storage domains done >2012-08-07 14:39:05,491 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-42) [6a5ed7bc] Running command: StopVmCommand internal: false. Entities affected : ID: e5a192f1-3f9d-48e1-a817-28f72815c646 Type: VM >2012-08-07 14:39:05,493 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-42) [6a5ed7bc] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, force=false, secondsToWait=0, gracefully=false), log id: b568249 >2012-08-07 14:39:05,500 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-42) [6a5ed7bc] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, force=false, secondsToWait=0, gracefully=false), log id: 336b484d >2012-08-07 14:39:05,878 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-42) [6a5ed7bc] FINISH, DestroyVDSCommand, log id: 336b484d >2012-08-07 14:39:05,901 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-42) [6a5ed7bc] FINISH, DestroyVmVDSCommand, return: Down, log id: b568249 >2012-08-07 14:39:32,435 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) Start time: 8/7/12 2:39 PM >2012-08-07 14:39:32,592 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: CbcCheckOnVdsChange >2012-08-07 14:39:32,611 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: CAEngineKey >2012-08-07 14:39:32,615 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: ENGINEEARLib >2012-08-07 14:39:32,639 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: MinimalETLVersion >2012-08-07 14:39:32,948 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: ScriptsPath >2012-08-07 14:39:32,949 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-2) Could not find enum value for option: SQLServerI18NPrefix >2012-08-07 14:39:33,063 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (MSC service thread 1-2) Failed to decrypt Data must start with zero >2012-08-07 14:39:33,067 ERROR [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (MSC service thread 1-2) Failed to decrypt value for property TruststorePass will be used encrypted value >2012-08-07 14:39:33,155 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) VDSBrokerFrontend: 8/7/12 2:39 PM >2012-08-07 14:39:33,170 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) CpuFlagsManager: 8/7/12 2:39 PM >2012-08-07 14:39:33,172 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-2) Setting audit clean up manager to run at: 35 35 3 * * ? >2012-08-07 14:39:33,212 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) AuditLogCleanupManager: 8/7/12 2:39 PM >2012-08-07 14:39:33,223 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-2) TagsDirector initialization >2012-08-07 14:39:33,274 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-2) Tag root added to tree >2012-08-07 14:39:33,292 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) TagsDirector: 8/7/12 2:39 PM >2012-08-07 14:39:33,309 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) IsoDomainListSyncronizer: 8/7/12 2:39 PM >2012-08-07 14:39:33,357 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) InitHandlers: 8/7/12 2:39 PM >2012-08-07 14:39:33,378 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-2) Code VDS_FENCING_OPERATION_FAILED appears more then once in string table. >2012-08-07 14:39:33,380 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) ErrorTranslator: 8/7/12 2:39 PM >2012-08-07 14:39:33,384 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) VdsErrorTranslator: 8/7/12 2:39 PM >2012-08-07 14:39:33,385 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) Mark uncompleted jobs as UNKNOWN: 8/7/12 2:39 PM >2012-08-07 14:39:33,476 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) JobRepositoryCleanupManager: 8/7/12 2:39 PM >2012-08-07 14:39:33,480 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) AutoRecoveryManager: 8/7/12 2:39 PM >2012-08-07 14:39:33,487 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) ExecutionMessageDirector: 8/7/12 2:39 PM >2012-08-07 14:39:33,511 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-1) InitResourceManager: 8/7/12 2:39 PM >2012-08-07 14:39:33,516 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (MSC service thread 1-2) UsersDomainsCacheManager: 8/7/12 2:39 PM >2012-08-07 14:39:33,519 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-1) ResourceManager::ResourceManager::Entered >2012-08-07 14:39:33,629 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (MSC service thread 1-2) DbUserCacheManager: 8/7/12 2:39 PM >2012-08-07 14:39:33,716 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-1) DbUserCacheManager::refreshAllUserData() - entered >2012-08-07 14:39:38,868 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) Eneterd VdsManager:constructor >2012-08-07 14:39:38,874 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) vdsBroker(purple-vds2,54,321) >2012-08-07 14:39:39,070 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-1) ResourceManager::AddVds - VDS 4196a566-dee6-11e1-b66e-c35c5273fee7 was added to the Resource Manager >2012-08-07 14:39:42,177 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: UNASSIGNED not exist in string table >2012-08-07 14:39:42,178 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table >2012-08-07 14:39:42,179 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: DWH_STOPPED not exist in string table >2012-08-07 14:39:42,184 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: DWH_STARTED not exist in string table >2012-08-07 14:39:42,184 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: DWH_ERROR not exist in string table >2012-08-07 14:39:42,193 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2012-08-07 14:39:42,193 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_FAILED_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2012-08-07 14:39:42,194 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2012-08-07 14:39:42,200 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_FAILED_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2012-08-07 14:39:44,077 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) Eneterd VdsManager:constructor >2012-08-07 14:39:44,079 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) vdsBroker(purple-vds3,54,321) >2012-08-07 14:39:44,094 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-1) ResourceManager::AddVds - VDS 47028088-dee6-11e1-bffa-2f8f15de3134 was added to the Resource Manager >2012-08-07 14:39:44,192 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (MSC service thread 1-1) AsyncTaskManager: Initialization of AsyncTaskManager completed successfully. >2012-08-07 14:39:44,193 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-1) AsyncTaskManager: 8/7/12 2:39 PM >2012-08-07 14:39:44,196 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-1) VdsLoadBalancer: 8/7/12 2:39 PM >2012-08-07 14:39:44,207 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (pool-3-thread-4) MacPoolManager started: 8/7/12 2:39 PM >2012-08-07 14:39:44,379 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-2) Initializing Host: purple-vds2 >2012-08-07 14:39:44,519 DEBUG [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-2) [66e03c24] Permission check skipped for internal action HandleVdsVersion. >2012-08-07 14:39:44,622 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (pool-3-thread-4) MacPoolManager finished: 8/7/12 2:39 PM >2012-08-07 14:39:44,759 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-2) [66e03c24] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4196a566-dee6-11e1-b66e-c35c5273fee7 Type: VDS >2012-08-07 14:39:46,764 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-3) Initializing Host: purple-vds3 >2012-08-07 14:39:46,774 DEBUG [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-3) [10c6182a] Permission check skipped for internal action HandleVdsVersion. >2012-08-07 14:39:46,780 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-3) [10c6182a] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 47028088-dee6-11e1-bffa-2f8f15de3134 Type: VDS >2012-08-07 14:39:54,283 DEBUG [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-15) [111a7a7f] Permission check skipped for internal action SetStoragePoolStatus. >2012-08-07 14:39:54,285 DEBUG [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-16) [72a2dd01] Permission check skipped for internal action SetStoragePoolStatus. >2012-08-07 14:39:54,334 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-15) [111a7a7f] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 7a858a05-d5d9-40de-9a4e-c24b1980eb23 Type: StoragePool >2012-08-07 14:39:54,334 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-16) [72a2dd01] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: efe20197-e0a7-49b8-beb4-19b1ed3f8c3f Type: StoragePool >2012-08-07 14:39:54,601 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-15) [111a7a7f] hostFromVds::selectedVds - purple-vds3, spmStatus SPM, storage pool scsi >2012-08-07 14:39:54,608 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [72a2dd01] hostFromVds::selectedVds - purple-vds2, spmStatus SPM, storage pool nfs31 >2012-08-07 14:39:54,643 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [72a2dd01] Initialize Irs proxy from vds: purple-vds2 >2012-08-07 14:39:54,653 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-15) [111a7a7f] Initialize Irs proxy from vds: purple-vds3 >2012-08-07 14:39:55,154 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) START, SPMGetAllTasksInfoVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4d68c07a >2012-08-07 14:39:55,155 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-19) START, SPMGetAllTasksInfoVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 2b637db0 >2012-08-07 14:39:55,366 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool 7a858a05-d5d9-40de-9a4e-c24b1980eb23 >2012-08-07 14:39:55,382 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-19) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool efe20197-e0a7-49b8-beb4-19b1ed3f8c3f >2012-08-07 14:39:55,396 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-19) START, HSMGetAllTasksInfoVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7), log id: 5c8c6866 >2012-08-07 14:39:55,403 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) START, HSMGetAllTasksInfoVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134), log id: 22c277b1 >2012-08-07 14:39:55,455 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-19) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 5c8c6866 >2012-08-07 14:39:55,456 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-19) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 2b637db0 >2012-08-07 14:39:55,459 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 22c277b1 >2012-08-07 14:39:55,459 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-18) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 4d68c07a >2012-08-07 14:39:55,460 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-18) Discovered no tasks on Storage Pool scsi >2012-08-07 14:39:55,457 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-19) Discovered no tasks on Storage Pool nfs31 >2012-08-07 14:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable hosts >2012-08-07 14:40:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Autorecovering 0 hosts >2012-08-07 14:40:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable hosts done >2012-08-07 14:40:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable storage domains >2012-08-07 14:40:00,073 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Autorecovering 1 storage domains >2012-08-07 14:40:00,075 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 14:40:00,081 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [7cc5a571] Permission check skipped for internal action ActivateStorageDomain. >2012-08-07 14:40:00,108 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-26) [7cc5a571] Before acquiring lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:40:00,116 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-26) [7cc5a571] Successed acquiring lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] succeeded >2012-08-07 14:40:00,117 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [7cc5a571] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:40:00,173 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [7cc5a571] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 14:40:00,395 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-26) [7cc5a571] Before releasing a lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:40:00,397 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-26) [7cc5a571] The exclusive lock for key 99bb665e-3421-4afb-bf70-d7b879c591b3STORAGE is released and lock is removed from map >2012-08-07 14:40:00,397 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [7cc5a571] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:40:00,400 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [7cc5a571] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:40 PM >2012-08-07 14:40:00,419 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (QuartzScheduler_Worker-26) [7cc5a571] ResourceManager::searchBusinessObjects(HOST: status = UP and DATACENTER = scsi) - entered >2012-08-07 14:40:00,528 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (QuartzScheduler_Worker-26) [7cc5a571] Adding new value to configuration cache. >2012-08-07 14:40:00,529 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (QuartzScheduler_Worker-26) [7cc5a571] Didnt find the value of DBI18NPrefix in DB for version general - using default: >2012-08-07 14:40:00,535 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (QuartzScheduler_Worker-26) [7cc5a571] Adding new value to configuration cache. >2012-08-07 14:40:00,536 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (QuartzScheduler_Worker-26) [7cc5a571] Didnt find the value of DBPagingType in DB for version general - using default: Offset >2012-08-07 14:40:00,537 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (QuartzScheduler_Worker-26) [7cc5a571] Adding new value to configuration cache. >2012-08-07 14:40:00,538 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (QuartzScheduler_Worker-26) [7cc5a571] Didnt find the value of DBPagingSyntax in DB for version general - using default: OFFSET (%1$s -1) LIMIT %2$s >2012-08-07 14:40:00,545 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (QuartzScheduler_Worker-26) [7cc5a571] Adding new value to configuration cache. >2012-08-07 14:40:00,546 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (QuartzScheduler_Worker-26) [7cc5a571] Didnt find the value of DBSearchTemplate in DB for version general - using default: SELECT * FROM (%2$s) %1$s) as T1 %3$s >2012-08-07 14:40:00,645 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-29) [7cc5a571] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 555afa27 >2012-08-07 14:40:19,374 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp--127.0.0.1-8009-2) [724001e7] Running command: LogoutUserCommand internal: false. >2012-08-07 14:40:25,940 DEBUG [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-3) IsUserAutorizedToRunAction: Login - no permission check >2012-08-07 14:40:25,955 DEBUG [org.ovirt.engine.core.bll.adbroker.LdapBrokerBase] (ajp--127.0.0.1-8009-3) RunAdAction Entry, actionType=AuthenticateUser >2012-08-07 14:40:25,986 DEBUG [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-3) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running LoginAdminUser, on Bottom with id bbb00000-0000-0000-0000-123456789bbb >2012-08-07 14:40:26,036 DEBUG [org.ovirt.engine.core.bll.MultiLevelAdministrationHandler] (ajp--127.0.0.1-8009-3) LoginAdminUser: User logged to admin using role SuperUser >2012-08-07 14:40:26,037 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-3) Checking if user admin@internal is an admin, result true >2012-08-07 14:40:26,042 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-3) Running command: LoginAdminUserCommand internal: false. >2012-08-07 14:40:31,067 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(DataCenter: sortby name) - entered >2012-08-07 14:40:31,211 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-9) ResourceManager::searchBusinessObjects(Host: ) - entered >2012-08-07 14:40:31,512 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Vms:) - entered >2012-08-07 14:40:35,429 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-5) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:40:40,246 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:40:44,195 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-99) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 14:40:44,202 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-99) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 14:40:44,202 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-99) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 14:40:44,203 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-99) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 14:40:45,300 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-20) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:40:45,721 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/7/12 2:40 PM. Start running CanDoAction for command number 1/10 (Command type: RunVm) >2012-08-07 14:40:45,722 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) Start time: 8/7/12 2:40 PM. Start running CanDoAction for command number 2/10 (Command type: RunVm) >2012-08-07 14:40:45,725 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) Start time: 8/7/12 2:40 PM. Start running CanDoAction for command number 3/10 (Command type: RunVm) >2012-08-07 14:40:45,728 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/7/12 2:40 PM. Start running CanDoAction for command number 4/10 (Command type: RunVm) >2012-08-07 14:40:45,731 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/7/12 2:40 PM. Start running CanDoAction for command number 5/10 (Command type: RunVm) >2012-08-07 14:40:45,732 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/7/12 2:40 PM. Start running CanDoAction for command number 6/10 (Command type: RunVm) >2012-08-07 14:40:45,740 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) Start time: 8/7/12 2:40 PM. Start running CanDoAction for command number 7/10 (Command type: RunVm) >2012-08-07 14:40:45,743 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/7/12 2:40 PM. Start running CanDoAction for command number 8/10 (Command type: RunVm) >2012-08-07 14:40:45,746 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) Start time: 8/7/12 2:40 PM. Start running CanDoAction for command number 9/10 (Command type: RunVm) >2012-08-07 14:40:45,747 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-41) Start time: 8/7/12 2:40 PM. Start running CanDoAction for command number 10/10 (Command type: RunVm) >2012-08-07 14:40:45,802 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 >2012-08-07 14:40:45,803 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 >2012-08-07 14:40:45,824 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 2842672f-6230-434f-8232-e88e71560092 >2012-08-07 14:40:45,825 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-44) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 5524b98a-aa45-49cb-9d8b-bec3884753c9 >2012-08-07 14:40:45,826 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-47) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id e5a192f1-3f9d-48e1-a817-28f72815c646 >2012-08-07 14:40:45,827 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 6c1fcddf-86d6-4533-905b-abb11b775f5b >2012-08-07 14:40:45,911 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-49) Before acquiring lock EngineLock [exclusiveLocks= key: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 value: VM >, sharedLocks= ] >2012-08-07 14:40:45,912 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-49) Successed acquiring lock EngineLock [exclusiveLocks= key: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:40:45,918 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-48) Before acquiring lock EngineLock [exclusiveLocks= key: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 value: VM >, sharedLocks= ] >2012-08-07 14:40:45,921 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-48) Successed acquiring lock EngineLock [exclusiveLocks= key: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:40:45,917 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-44) Before acquiring lock EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] >2012-08-07 14:40:45,915 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) Before acquiring lock EngineLock [exclusiveLocks= key: 6c1fcddf-86d6-4533-905b-abb11b775f5b value: VM >, sharedLocks= ] >2012-08-07 14:40:45,903 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-47) Before acquiring lock EngineLock [exclusiveLocks= key: e5a192f1-3f9d-48e1-a817-28f72815c646 value: VM >, sharedLocks= ] >2012-08-07 14:40:45,904 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) Before acquiring lock EngineLock [exclusiveLocks= key: 2842672f-6230-434f-8232-e88e71560092 value: VM >, sharedLocks= ] >2012-08-07 14:40:45,924 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) Successed acquiring lock EngineLock [exclusiveLocks= key: 2842672f-6230-434f-8232-e88e71560092 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:40:45,925 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-47) Successed acquiring lock EngineLock [exclusiveLocks= key: e5a192f1-3f9d-48e1-a817-28f72815c646 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:40:45,926 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) Successed acquiring lock EngineLock [exclusiveLocks= key: 6c1fcddf-86d6-4533-905b-abb11b775f5b value: VM >, sharedLocks= ] succeeded >2012-08-07 14:40:45,928 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-44) Successed acquiring lock EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:40:45,943 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-43) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 6df57989-99a7-4ec9-8f7c-15f222064e61 >2012-08-07 14:40:45,949 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-44) Lock Acquired to object EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] >2012-08-07 14:40:45,951 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) Lock Acquired to object EngineLock [exclusiveLocks= key: 6c1fcddf-86d6-4533-905b-abb11b775f5b value: VM >, sharedLocks= ] >2012-08-07 14:40:45,953 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-47) Lock Acquired to object EngineLock [exclusiveLocks= key: e5a192f1-3f9d-48e1-a817-28f72815c646 value: VM >, sharedLocks= ] >2012-08-07 14:40:45,954 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) Lock Acquired to object EngineLock [exclusiveLocks= key: 2842672f-6230-434f-8232-e88e71560092 value: VM >, sharedLocks= ] >2012-08-07 14:40:45,955 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) Lock Acquired to object EngineLock [exclusiveLocks= key: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 value: VM >, sharedLocks= ] >2012-08-07 14:40:45,955 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) Lock Acquired to object EngineLock [exclusiveLocks= key: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 value: VM >, sharedLocks= ] >2012-08-07 14:40:46,013 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-43) Before acquiring lock EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-07 14:40:46,014 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-43) Successed acquiring lock EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:40:46,015 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-43) Lock Acquired to object EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-07 14:40:46,037 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 3c7c0453-5f05-4314-bdd4-eb4fd243f80a >2012-08-07 14:40:46,040 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-50) Before acquiring lock EngineLock [exclusiveLocks= key: 3c7c0453-5f05-4314-bdd4-eb4fd243f80a value: VM >, sharedLocks= ] >2012-08-07 14:40:46,041 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-50) Successed acquiring lock EngineLock [exclusiveLocks= key: 3c7c0453-5f05-4314-bdd4-eb4fd243f80a value: VM >, sharedLocks= ] succeeded >2012-08-07 14:40:46,041 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) Lock Acquired to object EngineLock [exclusiveLocks= key: 3c7c0453-5f05-4314-bdd4-eb4fd243f80a value: VM >, sharedLocks= ] >2012-08-07 14:40:46,178 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 >2012-08-07 14:40:46,181 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) Before acquiring lock EngineLock [exclusiveLocks= key: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 value: VM >, sharedLocks= ] >2012-08-07 14:40:46,182 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) Successed acquiring lock EngineLock [exclusiveLocks= key: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:40:46,205 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) Lock Acquired to object EngineLock [exclusiveLocks= key: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 value: VM >, sharedLocks= ] >2012-08-07 14:40:46,345 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id d3c805a2-419c-480f-8627-f5c9ef5c4117 >2012-08-07 14:40:46,428 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-42) Before acquiring lock EngineLock [exclusiveLocks= key: d3c805a2-419c-480f-8627-f5c9ef5c4117 value: VM >, sharedLocks= ] >2012-08-07 14:40:46,430 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-42) Successed acquiring lock EngineLock [exclusiveLocks= key: d3c805a2-419c-480f-8627-f5c9ef5c4117 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:40:46,431 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-42) Lock Acquired to object EngineLock [exclusiveLocks= key: d3c805a2-419c-480f-8627-f5c9ef5c4117 value: VM >, sharedLocks= ] >2012-08-07 14:40:46,589 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 163093eb >2012-08-07 14:40:46,612 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-47) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 3e9bb427 >2012-08-07 14:40:46,625 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-47) FINISH, IsValidVDSCommand, return: true, log id: 3e9bb427 >2012-08-07 14:40:46,621 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 11ab65e0 >2012-08-07 14:40:46,643 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-42) FINISH, IsValidVDSCommand, return: true, log id: 163093eb >2012-08-07 14:40:46,748 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-44) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6792463d >2012-08-07 14:40:46,758 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 393b9273 >2012-08-07 14:40:46,772 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-42) START, IsVmDuringInitiatingVDSCommand(vmId = d3c805a2-419c-480f-8627-f5c9ef5c4117), log id: 7e361fbe >2012-08-07 14:40:46,773 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-42) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 7e361fbe >2012-08-07 14:40:46,788 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-44) FINISH, IsValidVDSCommand, return: true, log id: 6792463d >2012-08-07 14:40:46,789 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-47) START, IsVmDuringInitiatingVDSCommand(vmId = e5a192f1-3f9d-48e1-a817-28f72815c646), log id: 2f756087 >2012-08-07 14:40:46,809 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-47) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 2f756087 >2012-08-07 14:40:46,804 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) FINISH, IsValidVDSCommand, return: true, log id: 11ab65e0 >2012-08-07 14:40:46,812 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-48) FINISH, IsValidVDSCommand, return: true, log id: 393b9273 >2012-08-07 14:40:46,858 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 76eede41 >2012-08-07 14:40:46,922 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) FINISH, IsValidVDSCommand, return: true, log id: 76eede41 >2012-08-07 14:40:46,951 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-48) START, IsVmDuringInitiatingVDSCommand(vmId = 9dbe6b1e-2a98-449e-8bd7-2d025c420a42), log id: 58c7c158 >2012-08-07 14:40:46,952 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-48) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 58c7c158 >2012-08-07 14:40:46,954 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 32347027 >2012-08-07 14:40:46,967 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) START, IsVmDuringInitiatingVDSCommand(vmId = 2842672f-6230-434f-8232-e88e71560092), log id: 5bfaff85 >2012-08-07 14:40:46,967 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 5bfaff85 >2012-08-07 14:40:46,971 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-44) START, IsVmDuringInitiatingVDSCommand(vmId = 5524b98a-aa45-49cb-9d8b-bec3884753c9), log id: f93e63d >2012-08-07 14:40:46,972 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-44) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: f93e63d >2012-08-07 14:40:46,975 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) FINISH, IsValidVDSCommand, return: true, log id: 32347027 >2012-08-07 14:40:47,068 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 5735b7a8 >2012-08-07 14:40:47,105 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-42) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:40:47,106 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-42) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:47,150 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-42) 898 <= ??? 9,881 >2012-08-07 14:40:47,151 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-47) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:40:47,152 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-47) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:47,153 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-47) 898 <= ??? 9,881 >2012-08-07 14:40:47,153 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-41) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: d8da25d >2012-08-07 14:40:47,149 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 668d230 >2012-08-07 14:40:47,149 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) FINISH, IsValidVDSCommand, return: true, log id: 5735b7a8 >2012-08-07 14:40:47,138 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-48) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:40:47,157 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-48) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:47,138 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:40:47,166 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:47,167 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) 898 <= ??? 9,881 >2012-08-07 14:40:47,108 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) START, IsVmDuringInitiatingVDSCommand(vmId = 6a729fb0-47fe-4eba-9ba3-2b939eee2b19), log id: 7fa977d0 >2012-08-07 14:40:47,168 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 7fa977d0 >2012-08-07 14:40:47,111 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-44) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:40:47,169 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-44) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:47,179 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-44) 898 <= ??? 9,881 >2012-08-07 14:40:47,180 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-48) 898 <= ??? 9,881 >2012-08-07 14:40:47,229 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-41) FINISH, IsValidVDSCommand, return: true, log id: d8da25d >2012-08-07 14:40:47,238 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) FINISH, IsValidVDSCommand, return: true, log id: 668d230 >2012-08-07 14:40:47,249 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-42) End time: 8/7/12 2:40 PM. Finish handling CanDoAction for command number 9/10 (Command type: RunVm) >2012-08-07 14:40:47,276 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) End time: 8/7/12 2:40 PM. Finish handling CanDoAction for command number 7/10 (Command type: RunVm) >2012-08-07 14:40:47,280 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) End time: 8/7/12 2:40 PM. Finish handling CanDoAction for command number 3/10 (Command type: RunVm) >2012-08-07 14:40:47,280 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/7/12 2:40 PM. Finish handling CanDoAction for command number 4/10 (Command type: RunVm) >2012-08-07 14:40:47,343 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/7/12 2:40 PM. Finish handling CanDoAction for command number 6/10 (Command type: RunVm) >2012-08-07 14:40:47,347 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-49) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:40:47,350 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-41) START, IsVmDuringInitiatingVDSCommand(vmId = a7d2a056-b67b-4bc5-b8ea-7afef2d2b861), log id: 15c51565 >2012-08-07 14:40:47,351 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-41) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 15c51565 >2012-08-07 14:40:47,364 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-49) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:47,365 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-49) 898 <= ??? 9,881 >2012-08-07 14:40:47,382 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) End time: 8/7/12 2:40 PM. Finish handling CanDoAction for command number 2/10 (Command type: RunVm) >2012-08-07 14:40:47,447 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:40:47,448 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:47,449 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) 898 <= ??? 9,881 >2012-08-07 14:40:47,455 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-41) End time: 8/7/12 2:40 PM. Finish handling CanDoAction for command number 10/10 (Command type: RunVm) >2012-08-07 14:40:47,555 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) START, IsVmDuringInitiatingVDSCommand(vmId = 6c1fcddf-86d6-4533-905b-abb11b775f5b), log id: 4d14bb9c >2012-08-07 14:40:47,555 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 4d14bb9c >2012-08-07 14:40:47,632 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:40:47,633 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:47,634 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) 898 <= ??? 9,881 >2012-08-07 14:40:47,660 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/7/12 2:40 PM. Finish handling CanDoAction for command number 5/10 (Command type: RunVm) >2012-08-07 14:40:47,765 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) START, IsVmDuringInitiatingVDSCommand(vmId = 3c7c0453-5f05-4314-bdd4-eb4fd243f80a), log id: 18e42e61 >2012-08-07 14:40:47,766 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 18e42e61 >2012-08-07 14:40:47,784 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-50) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:40:47,796 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-50) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:47,797 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-50) 898 <= ??? 9,881 >2012-08-07 14:40:47,831 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/7/12 2:40 PM. Finish handling CanDoAction for command number 1/10 (Command type: RunVm) >2012-08-07 14:40:47,872 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-43) START, IsVmDuringInitiatingVDSCommand(vmId = 6df57989-99a7-4ec9-8f7c-15f222064e61), log id: 384ab292 >2012-08-07 14:40:47,873 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-43) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 384ab292 >2012-08-07 14:40:47,939 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-43) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:40:47,940 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-43) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:47,940 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-43) 898 <= ??? 9,881 >2012-08-07 14:40:47,975 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/7/12 2:40 PM. Start running CanDoAction for command number 11/12 (Command type: RunVm) >2012-08-07 14:40:47,976 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/7/12 2:40 PM. Start running CanDoAction for command number 12/12 (Command type: RunVm) >2012-08-07 14:40:47,980 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/7/12 2:40 PM. Finish handling CanDoAction for command number 8/10 (Command type: RunVm) >2012-08-07 14:40:47,987 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id c1cb365c-a119-493c-964c-faf65a10c889 >2012-08-07 14:40:47,997 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-50) Before acquiring lock EngineLock [exclusiveLocks= key: c1cb365c-a119-493c-964c-faf65a10c889 value: VM >, sharedLocks= ] >2012-08-07 14:40:48,001 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id c7702cf0-88da-4885-9b9c-9e59772b3774 >2012-08-07 14:40:48,003 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-50) Successed acquiring lock EngineLock [exclusiveLocks= key: c1cb365c-a119-493c-964c-faf65a10c889 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:40:48,003 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) Lock Acquired to object EngineLock [exclusiveLocks= key: c1cb365c-a119-493c-964c-faf65a10c889 value: VM >, sharedLocks= ] >2012-08-07 14:40:48,018 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) Before acquiring lock EngineLock [exclusiveLocks= key: c7702cf0-88da-4885-9b9c-9e59772b3774 value: VM >, sharedLocks= ] >2012-08-07 14:40:48,019 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) Successed acquiring lock EngineLock [exclusiveLocks= key: c7702cf0-88da-4885-9b9c-9e59772b3774 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:40:48,020 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) Lock Acquired to object EngineLock [exclusiveLocks= key: c7702cf0-88da-4885-9b9c-9e59772b3774 value: VM >, sharedLocks= ] >2012-08-07 14:40:48,046 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 2905d969 >2012-08-07 14:40:48,048 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 153443e9 >2012-08-07 14:40:48,057 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) FINISH, IsValidVDSCommand, return: true, log id: 153443e9 >2012-08-07 14:40:48,061 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) FINISH, IsValidVDSCommand, return: true, log id: 2905d969 >2012-08-07 14:40:48,109 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) START, IsVmDuringInitiatingVDSCommand(vmId = c7702cf0-88da-4885-9b9c-9e59772b3774), log id: b7e8a6d >2012-08-07 14:40:48,110 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: b7e8a6d >2012-08-07 14:40:48,117 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:40:48,118 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:48,129 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) 898 <= ??? 9,881 >2012-08-07 14:40:48,133 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/7/12 2:40 PM. Finish handling CanDoAction for command number 12/12 (Command type: RunVm) >2012-08-07 14:40:48,234 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) START, IsVmDuringInitiatingVDSCommand(vmId = c1cb365c-a119-493c-964c-faf65a10c889), log id: 60af9732 >2012-08-07 14:40:48,235 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 60af9732 >2012-08-07 14:40:48,244 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-50) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:40:48,246 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-50) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:48,247 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-50) 898 <= ??? 9,881 >2012-08-07 14:40:48,263 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/7/12 2:40 PM. Finish handling CanDoAction for command number 11/12 (Command type: RunVm) >2012-08-07 14:40:48,421 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [1c55b56e] Running command: RunVmCommand internal: false. Entities affected : ID: d3c805a2-419c-480f-8627-f5c9ef5c4117 Type: VM >2012-08-07 14:40:48,457 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [1c55b56e] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:40:48,457 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [1c55b56e] Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:48,458 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [1c55b56e] 898 <= ??? 9,881 >2012-08-07 14:40:48,507 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [1c55b56e] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=d3c805a2-419c-480f-8627-f5c9ef5c4117, vm=org.ovirt.engine.core.common.businessentities.VM@340a977b), log id: d895866 >2012-08-07 14:40:48,538 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [1c55b56e] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=d3c805a2-419c-480f-8627-f5c9ef5c4117, vm=org.ovirt.engine.core.common.businessentities.VM@340a977b), log id: 1bde257c >2012-08-07 14:40:48,709 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [1c55b56e] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=d3c805a2-419c-480f-8627-f5c9ef5c4117,devices=[Ljava.util.Map;@6a5db7f9,acpiEnable=true,vmName=pool1-3,cpuType=Conroe,custom={device_9313a716-f457-4cf6-ac99-1d69ac546ee5=VmId=d3c805a2-419c-480f-8627-f5c9ef5c4117,DeviceId=9313a716-f457-4cf6-ac99-1d69ac546ee5,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_9313a716-f457-4cf6-ac99-1d69ac546ee5device_dfdfdc7f-ca95-404d-9898-f4c4bb675ef5=VmId=d3c805a2-419c-480f-8627-f5c9ef5c4117,DeviceId=dfdfdc7f-ca95-404d-9898-f4c4bb675ef5,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_9313a716-f457-4cf6-ac99-1d69ac546ee5device_dfdfdc7f-ca95-404d-9898-f4c4bb675ef5device_fd8b5c05-0967-4514-875e-1602722425aadevice_3e64766c-d282-4468-a9a0-0d6cd1b17eaf=VmId=d3c805a2-419c-480f-8627-f5c9ef5c4117,DeviceId=3e64766c-d282-4468-a9a0-0d6cd1b17eaf,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_9313a716-f457-4cf6-ac99-1d69ac546ee5device_dfdfdc7f-ca95-404d-9898-f4c4bb675ef5device_fd8b5c05-0967-4514-875e-1602722425aa=VmId=d3c805a2-419c-480f-8627-f5c9ef5c4117,DeviceId=fd8b5c05-0967-4514-875e-1602722425aa,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_9313a716-f457-4cf6-ac99-1d69ac546ee5device_dfdfdc7f-ca95-404d-9898-f4c4bb675ef5device_fd8b5c05-0967-4514-875e-1602722425aadevice_3e64766c-d282-4468-a9a0-0d6cd1b17eafdevice_48b218e6-fb9d-462a-a5ae-d9033dde7e56=VmId=d3c805a2-419c-480f-8627-f5c9ef5c4117,DeviceId=48b218e6-fb9d-462a-a5ae-d9033dde7e56,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1} >2012-08-07 14:40:48,720 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [1c55b56e] FINISH, CreateVDSCommand, log id: 1bde257c >2012-08-07 14:40:48,748 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [1c55b56e] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 1. Vm: pool1-3 >2012-08-07 14:40:48,846 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [1c55b56e] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: d895866 >2012-08-07 14:40:48,847 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [1c55b56e] Before releasing a lock EngineLock [exclusiveLocks= key: d3c805a2-419c-480f-8627-f5c9ef5c4117 value: VM >, sharedLocks= ] >2012-08-07 14:40:48,852 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [1c55b56e] The exclusive lock for key d3c805a2-419c-480f-8627-f5c9ef5c4117VM is released and lock is removed from map >2012-08-07 14:40:48,853 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [1c55b56e] Lock freed to object EngineLock [exclusiveLocks= key: d3c805a2-419c-480f-8627-f5c9ef5c4117 value: VM >, sharedLocks= ] >2012-08-07 14:40:49,034 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [53914786] Running command: RunVmCommand internal: false. Entities affected : ID: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 Type: VM >2012-08-07 14:40:49,070 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [53914786] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 512 MB >2012-08-07 14:40:49,071 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [53914786] Host Mem Conmmitted: 577, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:49,071 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [53914786] 1,987 <= ??? 9,881 >2012-08-07 14:40:49,127 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [53914786] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861, vm=org.ovirt.engine.core.common.businessentities.VM@75ab1eec), log id: 3fb844e >2012-08-07 14:40:49,140 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [53914786] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861, vm=org.ovirt.engine.core.common.businessentities.VM@75ab1eec), log id: 21fdaf0 >2012-08-07 14:40:49,275 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [53914786] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861,devices=[Ljava.util.Map;@18dd424d,acpiEnable=true,vmName=pool1-4,cpuType=Conroe,custom={device_ae69a065-7562-45fa-872f-63c61a9789e4=VmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861,DeviceId=ae69a065-7562-45fa-872f-63c61a9789e4,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_ae69a065-7562-45fa-872f-63c61a9789e4device_cf573fb9-0eaf-4ffe-b03d-b6922d4629b1device_00ee655d-e9d2-48ea-aea0-e4804db64265=VmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861,DeviceId=00ee655d-e9d2-48ea-aea0-e4804db64265,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_ae69a065-7562-45fa-872f-63c61a9789e4device_cf573fb9-0eaf-4ffe-b03d-b6922d4629b1device_00ee655d-e9d2-48ea-aea0-e4804db64265device_1a8151d7-c39a-4308-8c2b-83ba05c2fa05device_b1e9530b-5cc1-43c8-b01f-e3f68ecbe022=VmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861,DeviceId=b1e9530b-5cc1-43c8-b01f-e3f68ecbe022,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_ae69a065-7562-45fa-872f-63c61a9789e4device_cf573fb9-0eaf-4ffe-b03d-b6922d4629b1device_00ee655d-e9d2-48ea-aea0-e4804db64265device_1a8151d7-c39a-4308-8c2b-83ba05c2fa05=VmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861,DeviceId=1a8151d7-c39a-4308-8c2b-83ba05c2fa05,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_ae69a065-7562-45fa-872f-63c61a9789e4device_cf573fb9-0eaf-4ffe-b03d-b6922d4629b1=VmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861,DeviceId=cf573fb9-0eaf-4ffe-b03d-b6922d4629b1,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0} >2012-08-07 14:40:49,289 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [53914786] FINISH, CreateVDSCommand, log id: 21fdaf0 >2012-08-07 14:40:49,311 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [53914786] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 2. Vm: pool1-4 >2012-08-07 14:40:49,346 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [53914786] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 3fb844e >2012-08-07 14:40:49,348 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [53914786] Before releasing a lock EngineLock [exclusiveLocks= key: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 value: VM >, sharedLocks= ] >2012-08-07 14:40:49,348 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [53914786] The exclusive lock for key a7d2a056-b67b-4bc5-b8ea-7afef2d2b861VM is released and lock is removed from map >2012-08-07 14:40:49,349 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [53914786] Lock freed to object EngineLock [exclusiveLocks= key: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 value: VM >, sharedLocks= ] >2012-08-07 14:40:49,525 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [17c705f2] Running command: RunVmCommand internal: false. Entities affected : ID: 3c7c0453-5f05-4314-bdd4-eb4fd243f80a Type: VM >2012-08-07 14:40:49,614 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [17c705f2] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 1,024 MB >2012-08-07 14:40:49,615 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [17c705f2] Host Mem Conmmitted: 1,154, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:49,615 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [17c705f2] 3,076 <= ??? 9,881 >2012-08-07 14:40:49,647 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [17c705f2] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=3c7c0453-5f05-4314-bdd4-eb4fd243f80a, vm=org.ovirt.engine.core.common.businessentities.VM@6836b284), log id: 504ce4a3 >2012-08-07 14:40:49,657 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [17c705f2] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=3c7c0453-5f05-4314-bdd4-eb4fd243f80a, vm=org.ovirt.engine.core.common.businessentities.VM@6836b284), log id: 4d362540 >2012-08-07 14:40:49,775 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [17c705f2] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=3c7c0453-5f05-4314-bdd4-eb4fd243f80a,devices=[Ljava.util.Map;@60d5f619,acpiEnable=true,vmName=pool1-1,cpuType=Conroe,custom={device_c9fb57e9-409e-496e-970f-89f4f9555df1=VmId=3c7c0453-5f05-4314-bdd4-eb4fd243f80a,DeviceId=c9fb57e9-409e-496e-970f-89f4f9555df1,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_c9fb57e9-409e-496e-970f-89f4f9555df1device_8d20c1cf-df69-4da8-997e-4a754398ea9fdevice_1e23be5a-2b53-49a0-82a7-b07ac51a6d57device_7ac39a5f-0e7f-4bf3-9467-8946956dac33device_56e8f810-0814-42b6-b62c-d5a5ecf4e76e=VmId=3c7c0453-5f05-4314-bdd4-eb4fd243f80a,DeviceId=56e8f810-0814-42b6-b62c-d5a5ecf4e76e,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_c9fb57e9-409e-496e-970f-89f4f9555df1device_8d20c1cf-df69-4da8-997e-4a754398ea9fdevice_1e23be5a-2b53-49a0-82a7-b07ac51a6d57device_7ac39a5f-0e7f-4bf3-9467-8946956dac33=VmId=3c7c0453-5f05-4314-bdd4-eb4fd243f80a,DeviceId=7ac39a5f-0e7f-4bf3-9467-8946956dac33,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_c9fb57e9-409e-496e-970f-89f4f9555df1device_8d20c1cf-df69-4da8-997e-4a754398ea9fdevice_1e23be5a-2b53-49a0-82a7-b07ac51a6d57=VmId=3c7c0453-5f05-4314-bdd4-eb4fd243f80a,DeviceId=1e23be5a-2b53-49a0-82a7-b07ac51a6d57,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_c9fb57e9-409e-496e-970f-89f4f9555df1device_8d20c1cf-df69-4da8-997e-4a754398ea9f=VmId=3c7c0453-5f05-4314-bdd4-eb4fd243f80a,DeviceId=8d20c1cf-df69-4da8-997e-4a754398ea9f,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0} >2012-08-07 14:40:49,789 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [17c705f2] FINISH, CreateVDSCommand, log id: 4d362540 >2012-08-07 14:40:49,804 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [17c705f2] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 3. Vm: pool1-1 >2012-08-07 14:40:49,935 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [17c705f2] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 504ce4a3 >2012-08-07 14:40:49,936 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [17c705f2] Before releasing a lock EngineLock [exclusiveLocks= key: 3c7c0453-5f05-4314-bdd4-eb4fd243f80a value: VM >, sharedLocks= ] >2012-08-07 14:40:49,937 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [17c705f2] The exclusive lock for key 3c7c0453-5f05-4314-bdd4-eb4fd243f80aVM is released and lock is removed from map >2012-08-07 14:40:49,937 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [17c705f2] Lock freed to object EngineLock [exclusiveLocks= key: 3c7c0453-5f05-4314-bdd4-eb4fd243f80a value: VM >, sharedLocks= ] >2012-08-07 14:40:50,168 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-15) [111a7a7f] VM pool1-3 d3c805a2-419c-480f-8627-f5c9ef5c4117 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:40:50,189 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-15) [111a7a7f] START, FullListVdsCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=null, vmIds=[d3c805a2-419c-480f-8627-f5c9ef5c4117]), log id: 4291c5c2 >2012-08-07 14:40:50,216 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-15) [111a7a7f] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@704e65b2, log id: 4291c5c2 >2012-08-07 14:40:50,280 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:40:50,597 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [7038dcb7] Running command: RunVmCommand internal: false. Entities affected : ID: 6c1fcddf-86d6-4533-905b-abb11b775f5b Type: VM >2012-08-07 14:40:50,648 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [7038dcb7] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 1,536 MB >2012-08-07 14:40:50,649 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [7038dcb7] Host Mem Conmmitted: 1,731, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:50,650 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [7038dcb7] 4,165 <= ??? 9,881 >2012-08-07 14:40:50,711 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [7038dcb7] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, vm=org.ovirt.engine.core.common.businessentities.VM@8f8b3b2), log id: 27774b6c >2012-08-07 14:40:50,718 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [7038dcb7] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, vm=org.ovirt.engine.core.common.businessentities.VM@8f8b3b2), log id: 7a078a8c >2012-08-07 14:40:50,891 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [7038dcb7] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b,devices=[Ljava.util.Map;@4885aaea,acpiEnable=true,vmName=pool1-13,cpuType=Conroe,custom={device_c86af19c-c58e-4d61-b200-1e7968dd5364device_6f299b50-5662-4515-bd26-e64820371292device_45611b3a-352c-4a2a-88ec-8fa1b82a5fb3device_3f9a22c5-97ac-42a7-b0e1-15ae7d99545f=VmId=6c1fcddf-86d6-4533-905b-abb11b775f5b,DeviceId=3f9a22c5-97ac-42a7-b0e1-15ae7d99545f,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_c86af19c-c58e-4d61-b200-1e7968dd5364=VmId=6c1fcddf-86d6-4533-905b-abb11b775f5b,DeviceId=c86af19c-c58e-4d61-b200-1e7968dd5364,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_c86af19c-c58e-4d61-b200-1e7968dd5364device_6f299b50-5662-4515-bd26-e64820371292device_45611b3a-352c-4a2a-88ec-8fa1b82a5fb3device_3f9a22c5-97ac-42a7-b0e1-15ae7d99545fdevice_72d523d8-2f21-40ef-9fc4-86f7f6a739db=VmId=6c1fcddf-86d6-4533-905b-abb11b775f5b,DeviceId=72d523d8-2f21-40ef-9fc4-86f7f6a739db,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_c86af19c-c58e-4d61-b200-1e7968dd5364device_6f299b50-5662-4515-bd26-e64820371292=VmId=6c1fcddf-86d6-4533-905b-abb11b775f5b,DeviceId=6f299b50-5662-4515-bd26-e64820371292,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_c86af19c-c58e-4d61-b200-1e7968dd5364device_6f299b50-5662-4515-bd26-e64820371292device_45611b3a-352c-4a2a-88ec-8fa1b82a5fb3=VmId=6c1fcddf-86d6-4533-905b-abb11b775f5b,DeviceId=45611b3a-352c-4a2a-88ec-8fa1b82a5fb3,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0} >2012-08-07 14:40:50,903 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [7038dcb7] FINISH, CreateVDSCommand, log id: 7a078a8c >2012-08-07 14:40:50,917 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [7038dcb7] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 4. Vm: pool1-13 >2012-08-07 14:40:51,023 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [7038dcb7] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 27774b6c >2012-08-07 14:40:51,024 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [7038dcb7] Before releasing a lock EngineLock [exclusiveLocks= key: 6c1fcddf-86d6-4533-905b-abb11b775f5b value: VM >, sharedLocks= ] >2012-08-07 14:40:51,025 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [7038dcb7] The exclusive lock for key 6c1fcddf-86d6-4533-905b-abb11b775f5bVM is released and lock is removed from map >2012-08-07 14:40:51,027 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [7038dcb7] Lock freed to object EngineLock [exclusiveLocks= key: 6c1fcddf-86d6-4533-905b-abb11b775f5b value: VM >, sharedLocks= ] >2012-08-07 14:40:51,188 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [3059426f] Running command: RunVmCommand internal: false. Entities affected : ID: 2842672f-6230-434f-8232-e88e71560092 Type: VM >2012-08-07 14:40:51,202 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [3059426f] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 2,048 MB >2012-08-07 14:40:51,202 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [3059426f] Host Mem Conmmitted: 2,308, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:51,204 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [3059426f] 5,254 <= ??? 9,881 >2012-08-07 14:40:51,265 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [3059426f] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, vm=org.ovirt.engine.core.common.businessentities.VM@7b9d23fb), log id: 67bc4de1 >2012-08-07 14:40:51,271 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [3059426f] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, vm=org.ovirt.engine.core.common.businessentities.VM@7b9d23fb), log id: 502a3b70 >2012-08-07 14:40:51,361 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [3059426f] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=2842672f-6230-434f-8232-e88e71560092,devices=[Ljava.util.Map;@62565b38,acpiEnable=true,vmName=pool1-14,cpuType=Conroe,custom={device_289c487d-f8cd-4669-aff3-dc550734b3dbdevice_3a3f51b8-7bc6-44a9-93b8-e5e9a5d9227edevice_613290b1-6b0c-40fe-ad5a-15647d3fc0d5=VmId=2842672f-6230-434f-8232-e88e71560092,DeviceId=613290b1-6b0c-40fe-ad5a-15647d3fc0d5,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_289c487d-f8cd-4669-aff3-dc550734b3db=VmId=2842672f-6230-434f-8232-e88e71560092,DeviceId=289c487d-f8cd-4669-aff3-dc550734b3db,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_289c487d-f8cd-4669-aff3-dc550734b3dbdevice_3a3f51b8-7bc6-44a9-93b8-e5e9a5d9227edevice_613290b1-6b0c-40fe-ad5a-15647d3fc0d5device_b7fa1e9e-f3c3-4e67-8e54-4dd290b4ef7edevice_d7f5bcf8-f4da-4eec-9322-0ca93eee02e2=VmId=2842672f-6230-434f-8232-e88e71560092,DeviceId=d7f5bcf8-f4da-4eec-9322-0ca93eee02e2,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_289c487d-f8cd-4669-aff3-dc550734b3dbdevice_3a3f51b8-7bc6-44a9-93b8-e5e9a5d9227edevice_613290b1-6b0c-40fe-ad5a-15647d3fc0d5device_b7fa1e9e-f3c3-4e67-8e54-4dd290b4ef7e=VmId=2842672f-6230-434f-8232-e88e71560092,DeviceId=b7fa1e9e-f3c3-4e67-8e54-4dd290b4ef7e,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_289c487d-f8cd-4669-aff3-dc550734b3dbdevice_3a3f51b8-7bc6-44a9-93b8-e5e9a5d9227e=VmId=2842672f-6230-434f-8232-e88e71560092,DeviceId=3a3f51b8-7bc6-44a9-93b8-e5e9a5d9227e,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0} >2012-08-07 14:40:51,368 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [3059426f] FINISH, CreateVDSCommand, log id: 502a3b70 >2012-08-07 14:40:51,375 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [3059426f] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 5. Vm: pool1-14 >2012-08-07 14:40:51,445 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [3059426f] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 67bc4de1 >2012-08-07 14:40:51,446 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [3059426f] Before releasing a lock EngineLock [exclusiveLocks= key: 2842672f-6230-434f-8232-e88e71560092 value: VM >, sharedLocks= ] >2012-08-07 14:40:51,447 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [3059426f] The exclusive lock for key 2842672f-6230-434f-8232-e88e71560092VM is released and lock is removed from map >2012-08-07 14:40:51,447 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [3059426f] Lock freed to object EngineLock [exclusiveLocks= key: 2842672f-6230-434f-8232-e88e71560092 value: VM >, sharedLocks= ] >2012-08-07 14:40:51,642 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [3534ced8] Running command: RunVmCommand internal: false. Entities affected : ID: e5a192f1-3f9d-48e1-a817-28f72815c646 Type: VM >2012-08-07 14:40:51,663 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [3534ced8] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 2,560 MB >2012-08-07 14:40:51,663 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [3534ced8] Host Mem Conmmitted: 2,885, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:51,665 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [3534ced8] 6,343 <= ??? 9,881 >2012-08-07 14:40:51,690 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [3534ced8] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, vm=org.ovirt.engine.core.common.businessentities.VM@13c3638d), log id: 29783878 >2012-08-07 14:40:51,699 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [3534ced8] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, vm=org.ovirt.engine.core.common.businessentities.VM@13c3638d), log id: 63201ef7 >2012-08-07 14:40:51,800 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [3534ced8] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=e5a192f1-3f9d-48e1-a817-28f72815c646,devices=[Ljava.util.Map;@43bc94f,acpiEnable=true,vmName=pool1-12,cpuType=Conroe,custom={device_036b0e2d-319b-4b26-a6c1-676f9952948fdevice_957d61c0-d06b-440a-8ccc-053f839175dbdevice_60e2a884-cb59-4e66-b8d1-4796beb23fcbdevice_52fff909-b609-4459-a6da-72d1db9b0166device_7ad2d0b7-382d-4f06-92a8-08e0ffdfa00d=VmId=e5a192f1-3f9d-48e1-a817-28f72815c646,DeviceId=7ad2d0b7-382d-4f06-92a8-08e0ffdfa00d,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_036b0e2d-319b-4b26-a6c1-676f9952948fdevice_957d61c0-d06b-440a-8ccc-053f839175dbdevice_60e2a884-cb59-4e66-b8d1-4796beb23fcbdevice_52fff909-b609-4459-a6da-72d1db9b0166=VmId=e5a192f1-3f9d-48e1-a817-28f72815c646,DeviceId=52fff909-b609-4459-a6da-72d1db9b0166,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_036b0e2d-319b-4b26-a6c1-676f9952948fdevice_957d61c0-d06b-440a-8ccc-053f839175dbdevice_60e2a884-cb59-4e66-b8d1-4796beb23fcb=VmId=e5a192f1-3f9d-48e1-a817-28f72815c646,DeviceId=60e2a884-cb59-4e66-b8d1-4796beb23fcb,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_036b0e2d-319b-4b26-a6c1-676f9952948fdevice_957d61c0-d06b-440a-8ccc-053f839175db=VmId=e5a192f1-3f9d-48e1-a817-28f72815c646,DeviceId=957d61c0-d06b-440a-8ccc-053f839175db,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_036b0e2d-319b-4b26-a6c1-676f9952948f=VmId=e5a192f1-3f9d-48e1-a817-28f72815c646,DeviceId=036b0e2d-319b-4b26-a6c1-676f9952948f,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0} >2012-08-07 14:40:51,812 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [3534ced8] FINISH, CreateVDSCommand, log id: 63201ef7 >2012-08-07 14:40:51,822 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [3534ced8] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 6. Vm: pool1-12 >2012-08-07 14:40:51,877 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [3534ced8] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 29783878 >2012-08-07 14:40:51,878 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [3534ced8] Before releasing a lock EngineLock [exclusiveLocks= key: e5a192f1-3f9d-48e1-a817-28f72815c646 value: VM >, sharedLocks= ] >2012-08-07 14:40:51,883 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [3534ced8] The exclusive lock for key e5a192f1-3f9d-48e1-a817-28f72815c646VM is released and lock is removed from map >2012-08-07 14:40:51,884 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [3534ced8] Lock freed to object EngineLock [exclusiveLocks= key: e5a192f1-3f9d-48e1-a817-28f72815c646 value: VM >, sharedLocks= ] >2012-08-07 14:40:51,974 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [72c165dc] Running command: RunVmCommand internal: false. Entities affected : ID: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 Type: VM >2012-08-07 14:40:51,991 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [72c165dc] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 3,072 MB >2012-08-07 14:40:51,992 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [72c165dc] Host Mem Conmmitted: 3,462, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:51,996 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [72c165dc] 7,432 <= ??? 9,881 >2012-08-07 14:40:52,031 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [72c165dc] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, vm=org.ovirt.engine.core.common.businessentities.VM@611c45fa), log id: 595aef6a >2012-08-07 14:40:52,042 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [72c165dc] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, vm=org.ovirt.engine.core.common.businessentities.VM@611c45fa), log id: b85acbe >2012-08-07 14:40:52,147 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [72c165dc] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19,devices=[Ljava.util.Map;@4a01b00a,acpiEnable=true,vmName=pool1-10,cpuType=Conroe,custom={device_bb0588ec-a6aa-47f0-87f4-869c6eea9cbedevice_d9df53bc-ba84-4f03-9960-ae8c01a7c693=VmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19,DeviceId=d9df53bc-ba84-4f03-9960-ae8c01a7c693,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_bb0588ec-a6aa-47f0-87f4-869c6eea9cbe=VmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19,DeviceId=bb0588ec-a6aa-47f0-87f4-869c6eea9cbe,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_bb0588ec-a6aa-47f0-87f4-869c6eea9cbedevice_d9df53bc-ba84-4f03-9960-ae8c01a7c693device_b392f124-1396-4736-b107-fcef4375b787=VmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19,DeviceId=b392f124-1396-4736-b107-fcef4375b787,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_bb0588ec-a6aa-47f0-87f4-869c6eea9cbedevice_d9df53bc-ba84-4f03-9960-ae8c01a7c693device_b392f124-1396-4736-b107-fcef4375b787device_f124f45b-27a7-44c2-a39e-d99c123bf259device_6e6b9469-6c42-46ed-9884-6902aade3fc1=VmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19,DeviceId=6e6b9469-6c42-46ed-9884-6902aade3fc1,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_bb0588ec-a6aa-47f0-87f4-869c6eea9cbedevice_d9df53bc-ba84-4f03-9960-ae8c01a7c693device_b392f124-1396-4736-b107-fcef4375b787device_f124f45b-27a7-44c2-a39e-d99c123bf259=VmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19,DeviceId=f124f45b-27a7-44c2-a39e-d99c123bf259,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0} >2012-08-07 14:40:52,163 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [72c165dc] FINISH, CreateVDSCommand, log id: b85acbe >2012-08-07 14:40:52,175 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [72c165dc] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 7. Vm: pool1-10 >2012-08-07 14:40:52,244 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [72c165dc] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 595aef6a >2012-08-07 14:40:52,245 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [72c165dc] Before releasing a lock EngineLock [exclusiveLocks= key: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 value: VM >, sharedLocks= ] >2012-08-07 14:40:52,246 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [72c165dc] The exclusive lock for key 6a729fb0-47fe-4eba-9ba3-2b939eee2b19VM is released and lock is removed from map >2012-08-07 14:40:52,247 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [72c165dc] Lock freed to object EngineLock [exclusiveLocks= key: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 value: VM >, sharedLocks= ] >2012-08-07 14:40:52,351 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [79f5eb84] Running command: RunVmCommand internal: false. Entities affected : ID: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 Type: VM >2012-08-07 14:40:52,360 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [79f5eb84] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 3,584 MB >2012-08-07 14:40:52,361 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [79f5eb84] Host Mem Conmmitted: 4,039, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:52,362 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [79f5eb84] 8,521 <= ??? 9,881 >2012-08-07 14:40:52,388 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [79f5eb84] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42, vm=org.ovirt.engine.core.common.businessentities.VM@345f5784), log id: 1639eab2 >2012-08-07 14:40:52,398 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [79f5eb84] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42, vm=org.ovirt.engine.core.common.businessentities.VM@345f5784), log id: 120014b3 >2012-08-07 14:40:52,509 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [79f5eb84] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42,devices=[Ljava.util.Map;@58b47b0f,acpiEnable=true,vmName=pool1-11,cpuType=Conroe,custom={device_ebe823f7-b798-46c5-a793-2ec812c5e2d8device_13240011-4cdd-4a58-a04f-d79f80a3f4a4device_b788641f-b98d-4f8f-8b2b-b8d201cd2f13device_f0c95c43-cbff-4fff-83f9-e4fadb2578f3device_ae87f6a4-5292-41ab-8afe-25b287f374b1=VmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42,DeviceId=ae87f6a4-5292-41ab-8afe-25b287f374b1,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_ebe823f7-b798-46c5-a793-2ec812c5e2d8device_13240011-4cdd-4a58-a04f-d79f80a3f4a4=VmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42,DeviceId=13240011-4cdd-4a58-a04f-d79f80a3f4a4,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_ebe823f7-b798-46c5-a793-2ec812c5e2d8device_13240011-4cdd-4a58-a04f-d79f80a3f4a4device_b788641f-b98d-4f8f-8b2b-b8d201cd2f13device_f0c95c43-cbff-4fff-83f9-e4fadb2578f3=VmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42,DeviceId=f0c95c43-cbff-4fff-83f9-e4fadb2578f3,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_ebe823f7-b798-46c5-a793-2ec812c5e2d8=VmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42,DeviceId=ebe823f7-b798-46c5-a793-2ec812c5e2d8,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_ebe823f7-b798-46c5-a793-2ec812c5e2d8device_13240011-4cdd-4a58-a04f-d79f80a3f4a4device_b788641f-b98d-4f8f-8b2b-b8d201cd2f13=VmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42,DeviceId=b788641f-b98d-4f8f-8b2b-b8d201cd2f13,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0} >2012-08-07 14:40:52,516 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [79f5eb84] FINISH, CreateVDSCommand, log id: 120014b3 >2012-08-07 14:40:52,523 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [79f5eb84] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 8. Vm: pool1-11 >2012-08-07 14:40:52,572 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [79f5eb84] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 1639eab2 >2012-08-07 14:40:52,573 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [79f5eb84] Before releasing a lock EngineLock [exclusiveLocks= key: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 value: VM >, sharedLocks= ] >2012-08-07 14:40:52,575 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [79f5eb84] The exclusive lock for key 9dbe6b1e-2a98-449e-8bd7-2d025c420a42VM is released and lock is removed from map >2012-08-07 14:40:52,578 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [79f5eb84] Lock freed to object EngineLock [exclusiveLocks= key: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 value: VM >, sharedLocks= ] >2012-08-07 14:40:52,800 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [452fa723] Running command: RunVmCommand internal: false. Entities affected : ID: 5524b98a-aa45-49cb-9d8b-bec3884753c9 Type: VM >2012-08-07 14:40:52,828 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [452fa723] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 4,096 MB >2012-08-07 14:40:52,829 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [452fa723] Host Mem Conmmitted: 4,616, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:52,830 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [452fa723] 9,610 <= ??? 9,881 >2012-08-07 14:40:52,861 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-31) VM pool1-4 a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:40:52,865 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-31) VM pool1-1 3c7c0453-5f05-4314-bdd4-eb4fd243f80a moved from WaitForLaunch --> PoweringUp >2012-08-07 14:40:52,868 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-31) START, FullListVdsCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=null, vmIds=[a7d2a056-b67b-4bc5-b8ea-7afef2d2b861, 3c7c0453-5f05-4314-bdd4-eb4fd243f80a]), log id: 4461e871 >2012-08-07 14:40:52,916 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-31) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@77e375c9, log id: 4461e871 >2012-08-07 14:40:52,922 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [452fa723] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=5524b98a-aa45-49cb-9d8b-bec3884753c9, vm=org.ovirt.engine.core.common.businessentities.VM@34f75c60), log id: 2a0ce699 >2012-08-07 14:40:53,132 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [452fa723] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=5524b98a-aa45-49cb-9d8b-bec3884753c9, vm=org.ovirt.engine.core.common.businessentities.VM@34f75c60), log id: 3fa98fe9 >2012-08-07 14:40:53,598 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [452fa723] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=5524b98a-aa45-49cb-9d8b-bec3884753c9,devices=[Ljava.util.Map;@467d3d8f,acpiEnable=true,vmName=pool1-15,cpuType=Conroe,custom={device_040336ca-af20-4c48-8de6-7aa07a977b3cdevice_371919f0-cedf-4044-a35a-5192625d7ee9device_a2388560-cd47-4490-86b2-ac498ba469f1device_c9db19d0-739c-40de-9d3b-87f6e5774f47=VmId=5524b98a-aa45-49cb-9d8b-bec3884753c9,DeviceId=c9db19d0-739c-40de-9d3b-87f6e5774f47,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_040336ca-af20-4c48-8de6-7aa07a977b3cdevice_371919f0-cedf-4044-a35a-5192625d7ee9=VmId=5524b98a-aa45-49cb-9d8b-bec3884753c9,DeviceId=371919f0-cedf-4044-a35a-5192625d7ee9,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_040336ca-af20-4c48-8de6-7aa07a977b3cdevice_371919f0-cedf-4044-a35a-5192625d7ee9device_a2388560-cd47-4490-86b2-ac498ba469f1device_c9db19d0-739c-40de-9d3b-87f6e5774f47device_7fbaf308-59d7-4176-8721-aa8a59c20952=VmId=5524b98a-aa45-49cb-9d8b-bec3884753c9,DeviceId=7fbaf308-59d7-4176-8721-aa8a59c20952,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_040336ca-af20-4c48-8de6-7aa07a977b3cdevice_371919f0-cedf-4044-a35a-5192625d7ee9device_a2388560-cd47-4490-86b2-ac498ba469f1=VmId=5524b98a-aa45-49cb-9d8b-bec3884753c9,DeviceId=a2388560-cd47-4490-86b2-ac498ba469f1,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_040336ca-af20-4c48-8de6-7aa07a977b3c=VmId=5524b98a-aa45-49cb-9d8b-bec3884753c9,DeviceId=040336ca-af20-4c48-8de6-7aa07a977b3c,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0} >2012-08-07 14:40:53,606 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [452fa723] FINISH, CreateVDSCommand, log id: 3fa98fe9 >2012-08-07 14:40:53,620 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [452fa723] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 9. Vm: pool1-15 >2012-08-07 14:40:53,720 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [452fa723] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 2a0ce699 >2012-08-07 14:40:53,721 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [452fa723] Before releasing a lock EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] >2012-08-07 14:40:53,722 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [452fa723] The exclusive lock for key 5524b98a-aa45-49cb-9d8b-bec3884753c9VM is released and lock is removed from map >2012-08-07 14:40:53,723 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [452fa723] Lock freed to object EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] >2012-08-07 14:40:53,883 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [51c4c0bf] Running command: RunVmCommand internal: false. Entities affected : ID: c1cb365c-a119-493c-964c-faf65a10c889 Type: VM >2012-08-07 14:40:53,896 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [51c4c0bf] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 4,608 MB >2012-08-07 14:40:53,902 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [51c4c0bf] Host Mem Conmmitted: 5,193, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:53,903 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [51c4c0bf] 10,699 <= ??? 9,881 >2012-08-07 14:40:53,904 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [51c4c0bf] Cant find VDS to run the VM c1cb365c-a119-493c-964c-faf65a10c889 on, so this VM will not be run. >2012-08-07 14:40:53,967 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [51c4c0bf] Command [id=4d9bfd28-7b90-4309-8727-50a6405c75e0]: No compensation data. >2012-08-07 14:40:53,973 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [51c4c0bf] Before releasing a lock EngineLock [exclusiveLocks= key: c1cb365c-a119-493c-964c-faf65a10c889 value: VM >, sharedLocks= ] >2012-08-07 14:40:53,973 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [51c4c0bf] The exclusive lock for key c1cb365c-a119-493c-964c-faf65a10c889VM is released and lock is removed from map >2012-08-07 14:40:53,974 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [51c4c0bf] Lock freed to object EngineLock [exclusiveLocks= key: c1cb365c-a119-493c-964c-faf65a10c889 value: VM >, sharedLocks= ] >2012-08-07 14:40:54,115 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [3afaa77b] Running command: RunVmCommand internal: false. Entities affected : ID: c7702cf0-88da-4885-9b9c-9e59772b3774 Type: VM >2012-08-07 14:40:54,128 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [3afaa77b] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 4,608 MB >2012-08-07 14:40:54,128 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [3afaa77b] Host Mem Conmmitted: 5,193, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:54,129 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [3afaa77b] 10,699 <= ??? 9,881 >2012-08-07 14:40:54,130 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [3afaa77b] Cant find VDS to run the VM c7702cf0-88da-4885-9b9c-9e59772b3774 on, so this VM will not be run. >2012-08-07 14:40:54,161 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [3afaa77b] Command [id=cbce6bd5-fc82-482b-adfe-f0a39526ada2]: No compensation data. >2012-08-07 14:40:54,163 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [3afaa77b] Before releasing a lock EngineLock [exclusiveLocks= key: c7702cf0-88da-4885-9b9c-9e59772b3774 value: VM >, sharedLocks= ] >2012-08-07 14:40:54,163 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [3afaa77b] The exclusive lock for key c7702cf0-88da-4885-9b9c-9e59772b3774VM is released and lock is removed from map >2012-08-07 14:40:54,164 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [3afaa77b] Lock freed to object EngineLock [exclusiveLocks= key: c7702cf0-88da-4885-9b9c-9e59772b3774 value: VM >, sharedLocks= ] >2012-08-07 14:40:54,323 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [2608c64b] Running command: RunVmCommand internal: false. Entities affected : ID: 6df57989-99a7-4ec9-8f7c-15f222064e61 Type: VM >2012-08-07 14:40:54,334 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [2608c64b] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 4,608 MB >2012-08-07 14:40:54,337 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [2608c64b] Host Mem Conmmitted: 5,193, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:40:54,338 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) [2608c64b] 10,699 <= ??? 9,881 >2012-08-07 14:40:54,338 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [2608c64b] Cant find VDS to run the VM 6df57989-99a7-4ec9-8f7c-15f222064e61 on, so this VM will not be run. >2012-08-07 14:40:54,370 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [2608c64b] Command [id=1f03d4e3-98cb-4040-97db-dd508d9dcbb4]: No compensation data. >2012-08-07 14:40:54,372 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [2608c64b] Before releasing a lock EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-07 14:40:54,373 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) [2608c64b] The exclusive lock for key 6df57989-99a7-4ec9-8f7c-15f222064e61VM is released and lock is removed from map >2012-08-07 14:40:54,376 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [2608c64b] Lock freed to object EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-07 14:40:55,290 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:40:55,640 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-41) VM pool1-13 6c1fcddf-86d6-4533-905b-abb11b775f5b moved from WaitForLaunch --> PoweringUp >2012-08-07 14:40:55,644 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-41) VM pool1-14 2842672f-6230-434f-8232-e88e71560092 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:40:55,661 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-41) VM pool1-12 e5a192f1-3f9d-48e1-a817-28f72815c646 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:40:55,662 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-41) VM pool1-10 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:40:55,663 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-41) START, FullListVdsCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=null, vmIds=[6c1fcddf-86d6-4533-905b-abb11b775f5b, 2842672f-6230-434f-8232-e88e71560092, e5a192f1-3f9d-48e1-a817-28f72815c646, 6a729fb0-47fe-4eba-9ba3-2b939eee2b19]), log id: 1415ffb7 >2012-08-07 14:40:55,726 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-41) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@1a438f45, log id: 1415ffb7 >2012-08-07 14:40:58,383 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-44) VM pool1-15 5524b98a-aa45-49cb-9d8b-bec3884753c9 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:40:58,385 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-44) VM pool1-11 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:40:58,389 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-44) START, FullListVdsCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=null, vmIds=[5524b98a-aa45-49cb-9d8b-bec3884753c9, 9dbe6b1e-2a98-449e-8bd7-2d025c420a42]), log id: 77d55327 >2012-08-07 14:40:58,432 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-44) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@564662e7, log id: 77d55327 >2012-08-07 14:41:00,285 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:41:05,252 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:41:10,289 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:41:15,278 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:41:20,293 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:41:25,272 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:41:30,283 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-5) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:41:35,286 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:41:40,275 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:41:44,203 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-20) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 14:41:44,212 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-20) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 14:41:44,213 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-20) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 14:41:44,213 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-20) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 14:41:45,289 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:41:49,446 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-29) VM pool1-3 d3c805a2-419c-480f-8627-f5c9ef5c4117 moved from PoweringUp --> Up >2012-08-07 14:41:49,447 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-29) VM pool1-4 a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 moved from PoweringUp --> Up >2012-08-07 14:41:49,630 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-29) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@b4895db7), log id: 3cf5cd5c >2012-08-07 14:41:49,659 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-29) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 3cf5cd5c >2012-08-07 14:41:49,660 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-29) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 8. Vm: pool1-3 >2012-08-07 14:41:49,661 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-29) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 4,096. Vm: pool1-3 >2012-08-07 14:41:49,718 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-29) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@1c22fdd8), log id: 5175171f >2012-08-07 14:41:49,745 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-29) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 5175171f >2012-08-07 14:41:49,745 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-29) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 7. Vm: pool1-4 >2012-08-07 14:41:49,746 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-29) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 3,584. Vm: pool1-4 >2012-08-07 14:41:50,287 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:41:52,029 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-31) VM pool1-13 6c1fcddf-86d6-4533-905b-abb11b775f5b moved from PoweringUp --> Up >2012-08-07 14:41:52,030 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-31) VM pool1-14 2842672f-6230-434f-8232-e88e71560092 moved from PoweringUp --> Up >2012-08-07 14:41:52,031 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-31) VM pool1-12 e5a192f1-3f9d-48e1-a817-28f72815c646 moved from PoweringUp --> Up >2012-08-07 14:41:52,031 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-31) VM pool1-1 3c7c0453-5f05-4314-bdd4-eb4fd243f80a moved from PoweringUp --> Up >2012-08-07 14:41:52,062 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-31) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@83bc9df9), log id: 59f327d3 >2012-08-07 14:41:52,098 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-31) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 59f327d3 >2012-08-07 14:41:52,098 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-31) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 6. Vm: pool1-13 >2012-08-07 14:41:52,099 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-31) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 3,072. Vm: pool1-13 >2012-08-07 14:41:52,160 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-31) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@eb563e1a), log id: 3ecbca0b >2012-08-07 14:41:52,175 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-31) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 3ecbca0b >2012-08-07 14:41:52,175 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-31) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 5. Vm: pool1-14 >2012-08-07 14:41:52,176 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-31) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 2,560. Vm: pool1-14 >2012-08-07 14:41:52,243 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-31) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@52efde3b), log id: 6f68db88 >2012-08-07 14:41:52,262 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-31) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 6f68db88 >2012-08-07 14:41:52,263 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-31) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 4. Vm: pool1-12 >2012-08-07 14:41:52,264 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-31) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 2,048. Vm: pool1-12 >2012-08-07 14:41:52,294 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-31) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@ba897e5c), log id: 514ae5a4 >2012-08-07 14:41:52,304 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-31) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 514ae5a4 >2012-08-07 14:41:52,304 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-31) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 3. Vm: pool1-1 >2012-08-07 14:41:52,305 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-31) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 1,536. Vm: pool1-1 >2012-08-07 14:41:54,552 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-38) VM pool1-15 5524b98a-aa45-49cb-9d8b-bec3884753c9 moved from PoweringUp --> Up >2012-08-07 14:41:54,552 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-38) VM pool1-10 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 moved from PoweringUp --> Up >2012-08-07 14:41:54,553 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-38) VM pool1-11 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 moved from PoweringUp --> Up >2012-08-07 14:41:54,580 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-38) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@22231e7d), log id: 1d266e63 >2012-08-07 14:41:54,594 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-38) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 1d266e63 >2012-08-07 14:41:54,594 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-38) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 2. Vm: pool1-15 >2012-08-07 14:41:54,595 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-38) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 1,024. Vm: pool1-15 >2012-08-07 14:41:54,640 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-38) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@89bcbe9e), log id: 36588993 >2012-08-07 14:41:54,663 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-38) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 36588993 >2012-08-07 14:41:54,663 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-38) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 1. Vm: pool1-10 >2012-08-07 14:41:54,664 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-38) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 512. Vm: pool1-10 >2012-08-07 14:41:54,694 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-38) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@f1565ebf), log id: 5132b741 >2012-08-07 14:41:54,707 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-38) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 5132b741 >2012-08-07 14:41:54,709 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-38) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 0. Vm: pool1-11 >2012-08-07 14:41:54,710 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-38) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 0. Vm: pool1-11 >2012-08-07 14:41:55,283 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:42:00,286 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:42:05,285 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:42:10,284 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:42:15,286 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:42:20,286 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:42:25,271 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:42:30,287 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-5) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:42:35,285 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:42:40,281 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:42:44,214 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-18) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 14:42:44,221 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-18) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 14:42:44,222 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-18) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 14:42:44,222 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-18) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 14:42:45,285 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-20) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:42:50,282 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-12) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:42:55,281 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:43:00,282 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:43:00,670 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-29) [7cc5a571] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 14:43:00,671 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-29) [7cc5a571] FINISH, ConnectStorageServerVDSCommand, log id: 555afa27 >2012-08-07 14:43:00,672 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-29) [7cc5a571] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 14:43:00,679 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [7cc5a571] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:43 PM >2012-08-07 14:43:00,681 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-26) [7cc5a571] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 5a6749a1 >2012-08-07 14:43:00,937 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-26) [7cc5a571] Failed in ActivateStorageDomainVDS method >2012-08-07 14:43:00,938 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-26) [7cc5a571] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:43:00,941 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) [7cc5a571] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:43:00,949 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-26) [7cc5a571] FINISH, ActivateStorageDomainVDSCommand, log id: 5a6749a1 >2012-08-07 14:43:00,950 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [7cc5a571] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:43:00,951 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [7cc5a571] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand.executeCommand(ActivateStorageDomainCommand.java:67) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteWithoutTransaction(CommandBase.java:810) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:901) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1256) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:168) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:107) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.Execute(CommandBase.java:916) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteAction(CommandBase.java:275) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:335) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:288) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.check(AutoRecoveryManager.java:96) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.onTimer(AutoRecoveryManager.java:63) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:64) [engine-scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz-2.1.2.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz-2.1.2.jar:] > >2012-08-07 14:43:00,978 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [7cc5a571] Command [id=a1e68d99-441a-4394-9ce0-ca0db03b1728]: Going over compensation data. >2012-08-07 14:43:01,013 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [7cc5a571] Command [id=a1e68d99-441a-4394-9ce0-ca0db03b1728]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 14:43:01,058 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [7cc5a571] Checking autorecoverable storage domains done >2012-08-07 14:43:05,288 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:43:10,285 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:43:15,280 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-20) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:43:20,281 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-12) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:43:25,281 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:43:30,281 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-5) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:43:35,282 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:43:40,283 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:43:44,223 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-24) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 14:43:44,230 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-24) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 14:43:44,230 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-24) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 14:43:44,231 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-24) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 14:43:45,281 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:43:50,280 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:43:55,279 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-9) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:44:00,280 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:44:05,282 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:44:10,280 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:44:15,279 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:44:20,278 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:44:25,271 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:44:30,281 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:44:35,291 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:44:40,260 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:44:44,231 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-30) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 14:44:44,233 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-30) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 14:44:44,234 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-30) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 14:44:44,234 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-30) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 14:44:45,281 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:44:50,283 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:44:55,279 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable hosts >2012-08-07 14:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Autorecovering 0 hosts >2012-08-07 14:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable hosts done >2012-08-07 14:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable storage domains >2012-08-07 14:45:00,160 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Autorecovering 1 storage domains >2012-08-07 14:45:00,161 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 14:45:00,162 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-57) [89ae2d3] Permission check skipped for internal action ActivateStorageDomain. >2012-08-07 14:45:00,164 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-57) [89ae2d3] Before acquiring lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:45:00,165 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-57) [89ae2d3] Successed acquiring lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] succeeded >2012-08-07 14:45:00,166 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-57) [89ae2d3] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:45:00,279 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:45:00,313 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-57) [89ae2d3] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 14:45:00,372 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-57) [89ae2d3] Before releasing a lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:45:00,373 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-57) [89ae2d3] The exclusive lock for key 99bb665e-3421-4afb-bf70-d7b879c591b3STORAGE is released and lock is removed from map >2012-08-07 14:45:00,374 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-57) [89ae2d3] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:45:00,375 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-57) [89ae2d3] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:45 PM >2012-08-07 14:45:00,391 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-30) [89ae2d3] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 335c9fd0 >2012-08-07 14:45:05,277 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:45:10,277 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:45:15,278 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:45:20,291 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:45:25,281 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:45:30,277 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:45:35,279 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:45:40,282 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:45:44,235 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-32) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 14:45:44,238 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-32) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 14:45:44,238 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-32) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 14:45:44,239 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-32) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 14:45:45,295 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:45:50,276 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:45:55,268 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:46:00,276 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-9) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:46:05,276 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:46:10,278 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:46:13,755 DEBUG [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-13) IsUserAutorizedToRunAction: Login - no permission check >2012-08-07 14:46:13,757 DEBUG [org.ovirt.engine.core.bll.adbroker.LdapBrokerBase] (ajp--127.0.0.1-8009-13) RunAdAction Entry, actionType=AuthenticateUser >2012-08-07 14:46:13,768 DEBUG [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-13) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running LoginAdminUser, on Bottom with id bbb00000-0000-0000-0000-123456789bbb >2012-08-07 14:46:13,787 DEBUG [org.ovirt.engine.core.bll.MultiLevelAdministrationHandler] (ajp--127.0.0.1-8009-13) LoginAdminUser: User logged to admin using role SuperUser >2012-08-07 14:46:13,788 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-13) Checking if user admin@internal is an admin, result true >2012-08-07 14:46:13,789 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp--127.0.0.1-8009-13) Running command: LoginAdminUserCommand internal: false. >2012-08-07 14:46:15,276 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:46:20,274 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:46:23,609 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:46:25,278 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:46:26,126 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/7/12 2:46 PM. Start running CanDoAction for command number 1/5 (Command type: ShutdownVm) >2012-08-07 14:46:26,130 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-29) Start time: 8/7/12 2:46 PM. Start running CanDoAction for command number 2/5 (Command type: ShutdownVm) >2012-08-07 14:46:26,138 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id e5a192f1-3f9d-48e1-a817-28f72815c646 >2012-08-07 14:46:26,141 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) Start time: 8/7/12 2:46 PM. Start running CanDoAction for command number 5/5 (Command type: ShutdownVm) >2012-08-07 14:46:26,142 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/7/12 2:46 PM. Start running CanDoAction for command number 4/5 (Command type: ShutdownVm) >2012-08-07 14:46:26,143 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-41) Start time: 8/7/12 2:46 PM. Start running CanDoAction for command number 3/5 (Command type: ShutdownVm) >2012-08-07 14:46:26,150 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-43) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 2842672f-6230-434f-8232-e88e71560092 >2012-08-07 14:46:26,151 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-41) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 6c1fcddf-86d6-4533-905b-abb11b775f5b >2012-08-07 14:46:26,140 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 >2012-08-07 14:46:26,182 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-49) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 >2012-08-07 14:46:26,187 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-29) End time: 8/7/12 2:46 PM. Finish handling CanDoAction for command number 2/5 (Command type: ShutdownVm) >2012-08-07 14:46:26,202 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) End time: 8/7/12 2:46 PM. Finish handling CanDoAction for command number 5/5 (Command type: ShutdownVm) >2012-08-07 14:46:26,278 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/7/12 2:46 PM. Finish handling CanDoAction for command number 1/5 (Command type: ShutdownVm) >2012-08-07 14:46:26,280 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-41) End time: 8/7/12 2:46 PM. Finish handling CanDoAction for command number 3/5 (Command type: ShutdownVm) >2012-08-07 14:46:26,283 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/7/12 2:46 PM. Finish handling CanDoAction for command number 4/5 (Command type: ShutdownVm) >2012-08-07 14:46:26,418 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-43) [65885bb2] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 Type: VM >2012-08-07 14:46:26,420 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-43) [65885bb2] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-11). >2012-08-07 14:46:26,421 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-43) [65885bb2] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-11. >2012-08-07 14:46:26,423 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-43) [65885bb2] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42, force=false, secondsToWait=30, gracefully=true), log id: 2925977 >2012-08-07 14:46:26,436 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-43) [65885bb2] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42, force=false, secondsToWait=30, gracefully=true), log id: 6b7f4c7e >2012-08-07 14:46:26,519 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-43) [65885bb2] FINISH, DestroyVDSCommand, log id: 6b7f4c7e >2012-08-07 14:46:26,560 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-43) [65885bb2] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 2925977 >2012-08-07 14:46:26,672 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-43) [2ed09add] Running command: ShutdownVmCommand internal: false. Entities affected : ID: e5a192f1-3f9d-48e1-a817-28f72815c646 Type: VM >2012-08-07 14:46:26,674 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-43) [2ed09add] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-12). >2012-08-07 14:46:26,674 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-43) [2ed09add] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-12. >2012-08-07 14:46:26,675 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-43) [2ed09add] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, force=false, secondsToWait=30, gracefully=true), log id: 31d3b8a1 >2012-08-07 14:46:26,680 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-43) [2ed09add] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, force=false, secondsToWait=30, gracefully=true), log id: 1847bb04 >2012-08-07 14:46:26,795 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-43) [2ed09add] FINISH, DestroyVDSCommand, log id: 1847bb04 >2012-08-07 14:46:26,828 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-43) [2ed09add] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 31d3b8a1 >2012-08-07 14:46:26,938 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-43) [1673b2e] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 6c1fcddf-86d6-4533-905b-abb11b775f5b Type: VM >2012-08-07 14:46:26,940 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-43) [1673b2e] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-13). >2012-08-07 14:46:26,941 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-43) [1673b2e] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-13. >2012-08-07 14:46:26,941 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-43) [1673b2e] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, force=false, secondsToWait=30, gracefully=true), log id: 1c019324 >2012-08-07 14:46:26,947 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-43) [1673b2e] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, force=false, secondsToWait=30, gracefully=true), log id: c032b95 >2012-08-07 14:46:27,012 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-43) [1673b2e] FINISH, DestroyVDSCommand, log id: c032b95 >2012-08-07 14:46:27,043 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-43) [1673b2e] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 1c019324 >2012-08-07 14:46:27,172 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-43) [205e49ba] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 2842672f-6230-434f-8232-e88e71560092 Type: VM >2012-08-07 14:46:27,174 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-43) [205e49ba] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-14). >2012-08-07 14:46:27,175 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-43) [205e49ba] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-14. >2012-08-07 14:46:27,176 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-43) [205e49ba] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, force=false, secondsToWait=30, gracefully=true), log id: 70bd6407 >2012-08-07 14:46:27,197 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:46:27,222 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-43) [205e49ba] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, force=false, secondsToWait=30, gracefully=true), log id: 47bb408 >2012-08-07 14:46:27,278 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-43) [205e49ba] FINISH, DestroyVDSCommand, log id: 47bb408 >2012-08-07 14:46:27,303 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-43) [205e49ba] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 70bd6407 >2012-08-07 14:46:27,421 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-43) [e3a62f0] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 Type: VM >2012-08-07 14:46:27,423 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-43) [e3a62f0] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-10). >2012-08-07 14:46:27,424 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-43) [e3a62f0] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-10. >2012-08-07 14:46:27,424 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-43) [e3a62f0] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, force=false, secondsToWait=30, gracefully=true), log id: 79dd0236 >2012-08-07 14:46:27,429 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-43) [e3a62f0] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, force=false, secondsToWait=30, gracefully=true), log id: 12022190 >2012-08-07 14:46:27,489 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-43) [e3a62f0] FINISH, DestroyVDSCommand, log id: 12022190 >2012-08-07 14:46:27,522 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-43) [e3a62f0] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 79dd0236 >2012-08-07 14:46:28,042 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/7/12 2:46 PM. Start running CanDoAction for command number 1/5 (Command type: ShutdownVm) >2012-08-07 14:46:28,045 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-41) Start time: 8/7/12 2:46 PM. Start running CanDoAction for command number 2/5 (Command type: ShutdownVm) >2012-08-07 14:46:28,049 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) Start time: 8/7/12 2:46 PM. Start running CanDoAction for command number 3/5 (Command type: ShutdownVm) >2012-08-07 14:46:28,053 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-49) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 6c1fcddf-86d6-4533-905b-abb11b775f5b >2012-08-07 14:46:28,054 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/7/12 2:46 PM. Start running CanDoAction for command number 4/5 (Command type: ShutdownVm) >2012-08-07 14:46:28,058 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 2842672f-6230-434f-8232-e88e71560092 >2012-08-07 14:46:28,060 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-29) Start time: 8/7/12 2:46 PM. Start running CanDoAction for command number 5/5 (Command type: ShutdownVm) >2012-08-07 14:46:28,067 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 >2012-08-07 14:46:28,079 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-43) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 >2012-08-07 14:46:28,084 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-29) End time: 8/7/12 2:46 PM. Finish handling CanDoAction for command number 5/5 (Command type: ShutdownVm) >2012-08-07 14:46:28,088 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/7/12 2:46 PM. Finish handling CanDoAction for command number 4/5 (Command type: ShutdownVm) >2012-08-07 14:46:28,092 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-41) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id e5a192f1-3f9d-48e1-a817-28f72815c646 >2012-08-07 14:46:28,098 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) End time: 8/7/12 2:46 PM. Finish handling CanDoAction for command number 3/5 (Command type: ShutdownVm) >2012-08-07 14:46:28,098 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/7/12 2:46 PM. Finish handling CanDoAction for command number 1/5 (Command type: ShutdownVm) >2012-08-07 14:46:28,100 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-41) End time: 8/7/12 2:46 PM. Finish handling CanDoAction for command number 2/5 (Command type: ShutdownVm) >2012-08-07 14:46:28,236 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-41) [5d745d86] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 Type: VM >2012-08-07 14:46:28,242 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-41) [5d745d86] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-11). >2012-08-07 14:46:28,243 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-41) [5d745d86] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-11, status is not up. Stopping instead. >2012-08-07 14:46:28,251 DEBUG [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-41) [5f09d325] Permission check skipped for internal action StopVm. >2012-08-07 14:46:28,257 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-41) [5f09d325] Running command: StopVmCommand internal: true. Entities affected : ID: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 Type: VM >2012-08-07 14:46:28,262 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-41) [5f09d325] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42, force=false, secondsToWait=0, gracefully=false), log id: 132e6060 >2012-08-07 14:46:28,282 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-41) [5f09d325] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42, force=false, secondsToWait=0, gracefully=false), log id: 1c5d5cbb >2012-08-07 14:46:28,645 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-41) [5f09d325] FINISH, DestroyVDSCommand, log id: 1c5d5cbb >2012-08-07 14:46:28,670 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-41) [5f09d325] FINISH, DestroyVmVDSCommand, return: Down, log id: 132e6060 >2012-08-07 14:46:28,784 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-41) [2a83859] Running command: ShutdownVmCommand internal: false. Entities affected : ID: e5a192f1-3f9d-48e1-a817-28f72815c646 Type: VM >2012-08-07 14:46:28,790 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-41) [2a83859] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-12). >2012-08-07 14:46:28,790 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-41) [2a83859] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-12, status is not up. Stopping instead. >2012-08-07 14:46:28,797 DEBUG [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-41) [37c1a5b5] Permission check skipped for internal action StopVm. >2012-08-07 14:46:28,801 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-41) [37c1a5b5] Running command: StopVmCommand internal: true. Entities affected : ID: e5a192f1-3f9d-48e1-a817-28f72815c646 Type: VM >2012-08-07 14:46:28,806 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-41) [37c1a5b5] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, force=false, secondsToWait=0, gracefully=false), log id: 1fff9923 >2012-08-07 14:46:28,815 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-41) [37c1a5b5] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, force=false, secondsToWait=0, gracefully=false), log id: 4b54e646 >2012-08-07 14:46:29,202 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-41) [37c1a5b5] FINISH, DestroyVDSCommand, log id: 4b54e646 >2012-08-07 14:46:29,245 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-41) [37c1a5b5] FINISH, DestroyVmVDSCommand, return: Down, log id: 1fff9923 >2012-08-07 14:46:29,359 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-41) [720b5c6b] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 6c1fcddf-86d6-4533-905b-abb11b775f5b Type: VM >2012-08-07 14:46:29,366 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-41) [720b5c6b] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-13). >2012-08-07 14:46:29,367 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-41) [720b5c6b] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-13, status is not up. Stopping instead. >2012-08-07 14:46:29,375 DEBUG [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-41) [30dddb72] Permission check skipped for internal action StopVm. >2012-08-07 14:46:29,377 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-41) [30dddb72] Running command: StopVmCommand internal: true. Entities affected : ID: 6c1fcddf-86d6-4533-905b-abb11b775f5b Type: VM >2012-08-07 14:46:29,381 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-41) [30dddb72] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, force=false, secondsToWait=0, gracefully=false), log id: 67c74858 >2012-08-07 14:46:29,427 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-41) [30dddb72] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, force=false, secondsToWait=0, gracefully=false), log id: 639a691a >2012-08-07 14:46:29,748 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Storage:) - entered >2012-08-07 14:46:29,786 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-41) [30dddb72] FINISH, DestroyVDSCommand, log id: 639a691a >2012-08-07 14:46:29,816 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-41) [30dddb72] FINISH, DestroyVmVDSCommand, return: Down, log id: 67c74858 >2012-08-07 14:46:30,237 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-41) [47e0af4b] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 2842672f-6230-434f-8232-e88e71560092 Type: VM >2012-08-07 14:46:30,240 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-41) [47e0af4b] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-14). >2012-08-07 14:46:30,240 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-41) [47e0af4b] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-14, status is not up. Stopping instead. >2012-08-07 14:46:30,244 DEBUG [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-41) [69127fe] Permission check skipped for internal action StopVm. >2012-08-07 14:46:30,245 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-41) [69127fe] Running command: StopVmCommand internal: true. Entities affected : ID: 2842672f-6230-434f-8232-e88e71560092 Type: VM >2012-08-07 14:46:30,247 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-41) [69127fe] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, force=false, secondsToWait=0, gracefully=false), log id: 4ecb671 >2012-08-07 14:46:30,251 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-41) [69127fe] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, force=false, secondsToWait=0, gracefully=false), log id: 1a0b050e >2012-08-07 14:46:30,285 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:46:30,606 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-41) [69127fe] FINISH, DestroyVDSCommand, log id: 1a0b050e >2012-08-07 14:46:30,638 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-41) [69127fe] FINISH, DestroyVmVDSCommand, return: Down, log id: 4ecb671 >2012-08-07 14:46:30,774 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-41) [701489ca] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 Type: VM >2012-08-07 14:46:30,776 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-41) [701489ca] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-10). >2012-08-07 14:46:30,776 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-41) [701489ca] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-10, status is not up. Stopping instead. >2012-08-07 14:46:30,782 DEBUG [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-41) [32a6111c] Permission check skipped for internal action StopVm. >2012-08-07 14:46:30,786 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-41) [32a6111c] Running command: StopVmCommand internal: true. Entities affected : ID: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 Type: VM >2012-08-07 14:46:30,788 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-41) [32a6111c] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, force=false, secondsToWait=0, gracefully=false), log id: 5947ad7a >2012-08-07 14:46:30,796 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-41) [32a6111c] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, force=false, secondsToWait=0, gracefully=false), log id: 24e01fd0 >2012-08-07 14:46:31,151 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-41) [32a6111c] FINISH, DestroyVDSCommand, log id: 24e01fd0 >2012-08-07 14:46:31,178 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-41) [32a6111c] FINISH, DestroyVmVDSCommand, return: Down, log id: 5947ad7a >2012-08-07 14:46:32,362 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:46:32,490 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(DataCenter:) - entered >2012-08-07 14:46:35,273 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:46:37,217 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:46:40,280 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:46:42,212 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:46:44,239 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-37) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 14:46:44,241 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-37) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 14:46:44,242 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-37) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 14:46:44,243 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-37) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 14:46:45,267 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:46:47,216 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:46:50,287 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:46:52,207 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:46:55,529 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:46:57,213 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:00,653 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:02,213 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:05,276 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:07,223 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:10,275 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:12,213 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:15,277 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:17,212 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:20,277 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:22,225 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:23,128 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-29) Start time: 8/7/12 2:47 PM. Start running CanDoAction for command number 5/5 (Command type: RunVm) >2012-08-07 14:47:23,129 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) Start time: 8/7/12 2:47 PM. Start running CanDoAction for command number 4/5 (Command type: RunVm) >2012-08-07 14:47:23,130 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/7/12 2:47 PM. Start running CanDoAction for command number 3/5 (Command type: RunVm) >2012-08-07 14:47:23,132 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/7/12 2:47 PM. Start running CanDoAction for command number 2/5 (Command type: RunVm) >2012-08-07 14:47:23,135 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-41) Start time: 8/7/12 2:47 PM. Start running CanDoAction for command number 1/5 (Command type: RunVm) >2012-08-07 14:47:23,147 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 >2012-08-07 14:47:23,159 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-29) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 2842672f-6230-434f-8232-e88e71560092 >2012-08-07 14:47:23,157 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id e5a192f1-3f9d-48e1-a817-28f72815c646 >2012-08-07 14:47:23,151 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-43) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 >2012-08-07 14:47:23,171 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-50) Before acquiring lock EngineLock [exclusiveLocks= key: e5a192f1-3f9d-48e1-a817-28f72815c646 value: VM >, sharedLocks= ] >2012-08-07 14:47:23,172 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-50) Successed acquiring lock EngineLock [exclusiveLocks= key: e5a192f1-3f9d-48e1-a817-28f72815c646 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:47:23,173 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-29) Before acquiring lock EngineLock [exclusiveLocks= key: 2842672f-6230-434f-8232-e88e71560092 value: VM >, sharedLocks= ] >2012-08-07 14:47:23,173 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-43) Before acquiring lock EngineLock [exclusiveLocks= key: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 value: VM >, sharedLocks= ] >2012-08-07 14:47:23,173 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) Before acquiring lock EngineLock [exclusiveLocks= key: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 value: VM >, sharedLocks= ] >2012-08-07 14:47:23,178 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-29) Successed acquiring lock EngineLock [exclusiveLocks= key: 2842672f-6230-434f-8232-e88e71560092 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:47:23,179 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-29) Lock Acquired to object EngineLock [exclusiveLocks= key: 2842672f-6230-434f-8232-e88e71560092 value: VM >, sharedLocks= ] >2012-08-07 14:47:23,179 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-43) Successed acquiring lock EngineLock [exclusiveLocks= key: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:47:23,183 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-43) Lock Acquired to object EngineLock [exclusiveLocks= key: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 value: VM >, sharedLocks= ] >2012-08-07 14:47:23,187 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) Successed acquiring lock EngineLock [exclusiveLocks= key: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:47:23,188 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) Lock Acquired to object EngineLock [exclusiveLocks= key: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 value: VM >, sharedLocks= ] >2012-08-07 14:47:23,179 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) Lock Acquired to object EngineLock [exclusiveLocks= key: e5a192f1-3f9d-48e1-a817-28f72815c646 value: VM >, sharedLocks= ] >2012-08-07 14:47:23,196 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 6c1fcddf-86d6-4533-905b-abb11b775f5b >2012-08-07 14:47:23,205 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-49) Before acquiring lock EngineLock [exclusiveLocks= key: 6c1fcddf-86d6-4533-905b-abb11b775f5b value: VM >, sharedLocks= ] >2012-08-07 14:47:23,206 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-49) Successed acquiring lock EngineLock [exclusiveLocks= key: 6c1fcddf-86d6-4533-905b-abb11b775f5b value: VM >, sharedLocks= ] succeeded >2012-08-07 14:47:23,222 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) Lock Acquired to object EngineLock [exclusiveLocks= key: 6c1fcddf-86d6-4533-905b-abb11b775f5b value: VM >, sharedLocks= ] >2012-08-07 14:47:23,230 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 62667440 >2012-08-07 14:47:23,228 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-41) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4d5b8283 >2012-08-07 14:47:23,237 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) FINISH, IsValidVDSCommand, return: true, log id: 62667440 >2012-08-07 14:47:23,243 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-41) FINISH, IsValidVDSCommand, return: true, log id: 4d5b8283 >2012-08-07 14:47:23,250 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-29) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 3ec78109 >2012-08-07 14:47:23,260 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-29) FINISH, IsValidVDSCommand, return: true, log id: 3ec78109 >2012-08-07 14:47:23,270 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 2d7a3d27 >2012-08-07 14:47:23,275 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1683ccab >2012-08-07 14:47:23,285 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) FINISH, IsValidVDSCommand, return: true, log id: 1683ccab >2012-08-07 14:47:23,289 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) FINISH, IsValidVDSCommand, return: true, log id: 2d7a3d27 >2012-08-07 14:47:23,345 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-43) START, IsVmDuringInitiatingVDSCommand(vmId = 9dbe6b1e-2a98-449e-8bd7-2d025c420a42), log id: 41fc04bc >2012-08-07 14:47:23,346 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-43) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 41fc04bc >2012-08-07 14:47:23,347 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-41) START, IsVmDuringInitiatingVDSCommand(vmId = 6a729fb0-47fe-4eba-9ba3-2b939eee2b19), log id: 32c11da1 >2012-08-07 14:47:23,356 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-41) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 32c11da1 >2012-08-07 14:47:23,347 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-29) START, IsVmDuringInitiatingVDSCommand(vmId = 2842672f-6230-434f-8232-e88e71560092), log id: 7528fd4d >2012-08-07 14:47:23,357 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-29) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 7528fd4d >2012-08-07 14:47:23,361 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:47:23,375 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) Host Mem Conmmitted: 2,308, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:47:23,371 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-43) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:47:23,369 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) START, IsVmDuringInitiatingVDSCommand(vmId = e5a192f1-3f9d-48e1-a817-28f72815c646), log id: 6567d01d >2012-08-07 14:47:23,385 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 6567d01d >2012-08-07 14:47:23,366 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-29) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:47:23,386 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-29) Host Mem Conmmitted: 2,308, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:47:23,385 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-43) Host Mem Conmmitted: 2,308, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:47:23,390 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-50) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:47:23,397 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) 3,206 <= ??? 9,881 >2012-08-07 14:47:23,398 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-43) 3,206 <= ??? 9,881 >2012-08-07 14:47:23,399 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-29) 3,206 <= ??? 9,881 >2012-08-07 14:47:23,404 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/7/12 2:47 PM. Finish handling CanDoAction for command number 2/5 (Command type: RunVm) >2012-08-07 14:47:23,397 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) START, IsVmDuringInitiatingVDSCommand(vmId = 6c1fcddf-86d6-4533-905b-abb11b775f5b), log id: 27ca32f1 >2012-08-07 14:47:23,406 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 27ca32f1 >2012-08-07 14:47:23,397 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-50) Host Mem Conmmitted: 2,308, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:47:23,418 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-50) 3,206 <= ??? 9,881 >2012-08-07 14:47:23,411 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-49) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:47:23,421 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-49) Host Mem Conmmitted: 2,308, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:47:23,421 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-49) 3,206 <= ??? 9,881 >2012-08-07 14:47:23,411 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-41) End time: 8/7/12 2:47 PM. Finish handling CanDoAction for command number 1/5 (Command type: RunVm) >2012-08-07 14:47:23,409 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-29) End time: 8/7/12 2:47 PM. Finish handling CanDoAction for command number 5/5 (Command type: RunVm) >2012-08-07 14:47:23,426 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/7/12 2:47 PM. Finish handling CanDoAction for command number 3/5 (Command type: RunVm) >2012-08-07 14:47:23,430 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) End time: 8/7/12 2:47 PM. Finish handling CanDoAction for command number 4/5 (Command type: RunVm) >2012-08-07 14:47:23,544 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [566d6035] Running command: RunVmCommand internal: false. Entities affected : ID: 6c1fcddf-86d6-4533-905b-abb11b775f5b Type: VM >2012-08-07 14:47:23,555 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [566d6035] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:47:23,558 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [566d6035] Host Mem Conmmitted: 2,308, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:47:23,562 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [566d6035] 3,206 <= ??? 9,881 >2012-08-07 14:47:23,590 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [566d6035] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, vm=org.ovirt.engine.core.common.businessentities.VM@176cc08), log id: 472a040 >2012-08-07 14:47:23,598 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [566d6035] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, vm=org.ovirt.engine.core.common.businessentities.VM@176cc08), log id: 78eda104 >2012-08-07 14:47:23,729 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [566d6035] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b,devices=[Ljava.util.Map;@49f04542,acpiEnable=true,vmName=pool1-13,cpuType=Conroe,custom={device_c86af19c-c58e-4d61-b200-1e7968dd5364device_65ae9fb9-6660-426f-8817-b0b850d87ae5device_9189ba8b-0360-42f3-a681-4c9a96c5400bdevice_93425d78-ddcd-4596-832a-5db6fc477713device_9a8ec46a-d7ea-4117-a1d9-14026d53f804=VmId=6c1fcddf-86d6-4533-905b-abb11b775f5b,DeviceId=9a8ec46a-d7ea-4117-a1d9-14026d53f804,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_c86af19c-c58e-4d61-b200-1e7968dd5364device_65ae9fb9-6660-426f-8817-b0b850d87ae5device_9189ba8b-0360-42f3-a681-4c9a96c5400b=VmId=6c1fcddf-86d6-4533-905b-abb11b775f5b,DeviceId=9189ba8b-0360-42f3-a681-4c9a96c5400b,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_c86af19c-c58e-4d61-b200-1e7968dd5364=VmId=6c1fcddf-86d6-4533-905b-abb11b775f5b,DeviceId=c86af19c-c58e-4d61-b200-1e7968dd5364,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_c86af19c-c58e-4d61-b200-1e7968dd5364device_65ae9fb9-6660-426f-8817-b0b850d87ae5device_9189ba8b-0360-42f3-a681-4c9a96c5400bdevice_93425d78-ddcd-4596-832a-5db6fc477713=VmId=6c1fcddf-86d6-4533-905b-abb11b775f5b,DeviceId=93425d78-ddcd-4596-832a-5db6fc477713,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_c86af19c-c58e-4d61-b200-1e7968dd5364device_65ae9fb9-6660-426f-8817-b0b850d87ae5=VmId=6c1fcddf-86d6-4533-905b-abb11b775f5b,DeviceId=65ae9fb9-6660-426f-8817-b0b850d87ae5,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0} >2012-08-07 14:47:23,774 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [566d6035] FINISH, CreateVDSCommand, log id: 78eda104 >2012-08-07 14:47:23,785 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [566d6035] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 1. Vm: pool1-13 >2012-08-07 14:47:23,831 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [566d6035] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 472a040 >2012-08-07 14:47:23,833 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) [566d6035] Before releasing a lock EngineLock [exclusiveLocks= key: 6c1fcddf-86d6-4533-905b-abb11b775f5b value: VM >, sharedLocks= ] >2012-08-07 14:47:23,837 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) [566d6035] The exclusive lock for key 6c1fcddf-86d6-4533-905b-abb11b775f5bVM is released and lock is removed from map >2012-08-07 14:47:23,840 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [566d6035] Lock freed to object EngineLock [exclusiveLocks= key: 6c1fcddf-86d6-4533-905b-abb11b775f5b value: VM >, sharedLocks= ] >2012-08-07 14:47:23,981 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [456da5e6] Running command: RunVmCommand internal: false. Entities affected : ID: 2842672f-6230-434f-8232-e88e71560092 Type: VM >2012-08-07 14:47:23,990 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [456da5e6] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 512 MB >2012-08-07 14:47:23,990 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [456da5e6] Host Mem Conmmitted: 2,885, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:47:23,993 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [456da5e6] 4,295 <= ??? 9,881 >2012-08-07 14:47:24,049 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [456da5e6] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, vm=org.ovirt.engine.core.common.businessentities.VM@6e8ae9b5), log id: 4ced49d7 >2012-08-07 14:47:24,056 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [456da5e6] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, vm=org.ovirt.engine.core.common.businessentities.VM@6e8ae9b5), log id: 230ec98 >2012-08-07 14:47:24,142 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [456da5e6] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=2842672f-6230-434f-8232-e88e71560092,devices=[Ljava.util.Map;@78f4c509,acpiEnable=true,vmName=pool1-14,cpuType=Conroe,custom={device_289c487d-f8cd-4669-aff3-dc550734b3db=VmId=2842672f-6230-434f-8232-e88e71560092,DeviceId=289c487d-f8cd-4669-aff3-dc550734b3db,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_289c487d-f8cd-4669-aff3-dc550734b3dbdevice_147ba3df-8f83-4162-816b-2868d7d61b83device_d87c72eb-5e1a-46da-ad9c-765811ea17f6=VmId=2842672f-6230-434f-8232-e88e71560092,DeviceId=d87c72eb-5e1a-46da-ad9c-765811ea17f6,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_289c487d-f8cd-4669-aff3-dc550734b3dbdevice_147ba3df-8f83-4162-816b-2868d7d61b83device_d87c72eb-5e1a-46da-ad9c-765811ea17f6device_21d6b64b-657c-46e2-829f-b05d57c9d604=VmId=2842672f-6230-434f-8232-e88e71560092,DeviceId=21d6b64b-657c-46e2-829f-b05d57c9d604,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_289c487d-f8cd-4669-aff3-dc550734b3dbdevice_147ba3df-8f83-4162-816b-2868d7d61b83=VmId=2842672f-6230-434f-8232-e88e71560092,DeviceId=147ba3df-8f83-4162-816b-2868d7d61b83,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_289c487d-f8cd-4669-aff3-dc550734b3dbdevice_147ba3df-8f83-4162-816b-2868d7d61b83device_d87c72eb-5e1a-46da-ad9c-765811ea17f6device_21d6b64b-657c-46e2-829f-b05d57c9d604device_f67bc914-8fb8-416f-943e-4838effb0535=VmId=2842672f-6230-434f-8232-e88e71560092,DeviceId=f67bc914-8fb8-416f-943e-4838effb0535,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1} >2012-08-07 14:47:24,169 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [456da5e6] FINISH, CreateVDSCommand, log id: 230ec98 >2012-08-07 14:47:24,178 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [456da5e6] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 2. Vm: pool1-14 >2012-08-07 14:47:24,243 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [456da5e6] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 4ced49d7 >2012-08-07 14:47:24,247 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) [456da5e6] Before releasing a lock EngineLock [exclusiveLocks= key: 2842672f-6230-434f-8232-e88e71560092 value: VM >, sharedLocks= ] >2012-08-07 14:47:24,251 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) [456da5e6] The exclusive lock for key 2842672f-6230-434f-8232-e88e71560092VM is released and lock is removed from map >2012-08-07 14:47:24,255 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [456da5e6] Lock freed to object EngineLock [exclusiveLocks= key: 2842672f-6230-434f-8232-e88e71560092 value: VM >, sharedLocks= ] >2012-08-07 14:47:24,440 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [3386368b] Running command: RunVmCommand internal: false. Entities affected : ID: e5a192f1-3f9d-48e1-a817-28f72815c646 Type: VM >2012-08-07 14:47:24,458 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [3386368b] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 1,024 MB >2012-08-07 14:47:24,461 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [3386368b] Host Mem Conmmitted: 3,462, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:47:24,465 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [3386368b] 5,384 <= ??? 9,881 >2012-08-07 14:47:24,488 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [3386368b] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, vm=org.ovirt.engine.core.common.businessentities.VM@76fc2460), log id: 7fbb9fdb >2012-08-07 14:47:24,493 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [3386368b] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, vm=org.ovirt.engine.core.common.businessentities.VM@76fc2460), log id: 171f51c0 >2012-08-07 14:47:24,594 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [3386368b] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=e5a192f1-3f9d-48e1-a817-28f72815c646,devices=[Ljava.util.Map;@1673fe66,acpiEnable=true,vmName=pool1-12,cpuType=Conroe,custom={device_036b0e2d-319b-4b26-a6c1-676f9952948fdevice_7b2a3cc3-dc3b-4486-a9c7-ee793053b97ddevice_bf1f689a-ea46-46ff-a201-a8ff214239e4device_5fd167cc-0f97-43c0-93af-52a7fc6a2402device_d509344f-55d3-44a5-9f5e-fa274f06142f=VmId=e5a192f1-3f9d-48e1-a817-28f72815c646,DeviceId=d509344f-55d3-44a5-9f5e-fa274f06142f,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_036b0e2d-319b-4b26-a6c1-676f9952948fdevice_7b2a3cc3-dc3b-4486-a9c7-ee793053b97ddevice_bf1f689a-ea46-46ff-a201-a8ff214239e4device_5fd167cc-0f97-43c0-93af-52a7fc6a2402=VmId=e5a192f1-3f9d-48e1-a817-28f72815c646,DeviceId=5fd167cc-0f97-43c0-93af-52a7fc6a2402,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_036b0e2d-319b-4b26-a6c1-676f9952948fdevice_7b2a3cc3-dc3b-4486-a9c7-ee793053b97ddevice_bf1f689a-ea46-46ff-a201-a8ff214239e4=VmId=e5a192f1-3f9d-48e1-a817-28f72815c646,DeviceId=bf1f689a-ea46-46ff-a201-a8ff214239e4,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_036b0e2d-319b-4b26-a6c1-676f9952948f=VmId=e5a192f1-3f9d-48e1-a817-28f72815c646,DeviceId=036b0e2d-319b-4b26-a6c1-676f9952948f,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_036b0e2d-319b-4b26-a6c1-676f9952948fdevice_7b2a3cc3-dc3b-4486-a9c7-ee793053b97d=VmId=e5a192f1-3f9d-48e1-a817-28f72815c646,DeviceId=7b2a3cc3-dc3b-4486-a9c7-ee793053b97d,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0} >2012-08-07 14:47:24,623 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [3386368b] FINISH, CreateVDSCommand, log id: 171f51c0 >2012-08-07 14:47:24,631 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [3386368b] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 3. Vm: pool1-12 >2012-08-07 14:47:24,682 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [3386368b] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 7fbb9fdb >2012-08-07 14:47:24,683 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) [3386368b] Before releasing a lock EngineLock [exclusiveLocks= key: e5a192f1-3f9d-48e1-a817-28f72815c646 value: VM >, sharedLocks= ] >2012-08-07 14:47:24,684 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) [3386368b] The exclusive lock for key e5a192f1-3f9d-48e1-a817-28f72815c646VM is released and lock is removed from map >2012-08-07 14:47:24,685 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [3386368b] Lock freed to object EngineLock [exclusiveLocks= key: e5a192f1-3f9d-48e1-a817-28f72815c646 value: VM >, sharedLocks= ] >2012-08-07 14:47:24,790 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [19113e04] Running command: RunVmCommand internal: false. Entities affected : ID: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 Type: VM >2012-08-07 14:47:24,802 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [19113e04] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 1,536 MB >2012-08-07 14:47:24,805 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [19113e04] Host Mem Conmmitted: 4,039, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:47:24,809 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [19113e04] 6,473 <= ??? 9,881 >2012-08-07 14:47:24,842 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [19113e04] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, vm=org.ovirt.engine.core.common.businessentities.VM@559ebe3a), log id: 71d11496 >2012-08-07 14:47:24,848 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [19113e04] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, vm=org.ovirt.engine.core.common.businessentities.VM@559ebe3a), log id: 5ee76a90 >2012-08-07 14:47:24,932 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [19113e04] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19,devices=[Ljava.util.Map;@4741591,acpiEnable=true,vmName=pool1-10,cpuType=Conroe,custom={device_bb0588ec-a6aa-47f0-87f4-869c6eea9cbedevice_ddbf7c82-8db9-41de-b6ed-0b2bb58fc6d4device_5433dd5d-13b9-4d69-bfae-a6cfb0b27e71=VmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19,DeviceId=5433dd5d-13b9-4d69-bfae-a6cfb0b27e71,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_bb0588ec-a6aa-47f0-87f4-869c6eea9cbedevice_ddbf7c82-8db9-41de-b6ed-0b2bb58fc6d4=VmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19,DeviceId=ddbf7c82-8db9-41de-b6ed-0b2bb58fc6d4,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_bb0588ec-a6aa-47f0-87f4-869c6eea9cbedevice_ddbf7c82-8db9-41de-b6ed-0b2bb58fc6d4device_5433dd5d-13b9-4d69-bfae-a6cfb0b27e71device_c59ec0a3-5e60-4c6f-a64c-eb5908e267fe=VmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19,DeviceId=c59ec0a3-5e60-4c6f-a64c-eb5908e267fe,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_bb0588ec-a6aa-47f0-87f4-869c6eea9cbe=VmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19,DeviceId=bb0588ec-a6aa-47f0-87f4-869c6eea9cbe,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_bb0588ec-a6aa-47f0-87f4-869c6eea9cbedevice_ddbf7c82-8db9-41de-b6ed-0b2bb58fc6d4device_5433dd5d-13b9-4d69-bfae-a6cfb0b27e71device_c59ec0a3-5e60-4c6f-a64c-eb5908e267fedevice_817588ac-6f66-4c49-9967-08a88d79d1ef=VmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19,DeviceId=817588ac-6f66-4c49-9967-08a88d79d1ef,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1} >2012-08-07 14:47:24,960 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [19113e04] FINISH, CreateVDSCommand, log id: 5ee76a90 >2012-08-07 14:47:24,968 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [19113e04] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 4. Vm: pool1-10 >2012-08-07 14:47:25,000 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [19113e04] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 71d11496 >2012-08-07 14:47:25,004 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) [19113e04] Before releasing a lock EngineLock [exclusiveLocks= key: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 value: VM >, sharedLocks= ] >2012-08-07 14:47:25,008 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) [19113e04] The exclusive lock for key 6a729fb0-47fe-4eba-9ba3-2b939eee2b19VM is released and lock is removed from map >2012-08-07 14:47:25,012 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [19113e04] Lock freed to object EngineLock [exclusiveLocks= key: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 value: VM >, sharedLocks= ] >2012-08-07 14:47:25,144 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [410438f6] Running command: RunVmCommand internal: false. Entities affected : ID: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 Type: VM >2012-08-07 14:47:25,157 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [410438f6] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 2,048 MB >2012-08-07 14:47:25,160 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [410438f6] Host Mem Conmmitted: 4,616, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:47:25,169 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [410438f6] 7,562 <= ??? 9,881 >2012-08-07 14:47:25,196 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [410438f6] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42, vm=org.ovirt.engine.core.common.businessentities.VM@4153dbdd), log id: 6dbbc063 >2012-08-07 14:47:25,246 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-18) START, FullListVdsCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=null, vmIds=[6c1fcddf-86d6-4533-905b-abb11b775f5b, 2842672f-6230-434f-8232-e88e71560092, e5a192f1-3f9d-48e1-a817-28f72815c646, 6a729fb0-47fe-4eba-9ba3-2b939eee2b19]), log id: 38d8750b >2012-08-07 14:47:25,268 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:25,299 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-18) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@696d38b1, log id: 38d8750b >2012-08-07 14:47:25,314 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-18) Recieved a Device without an address when processing VM 2842672f-6230-434f-8232-e88e71560092 devices, skipping device: {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=8cee58be-6fb1-4704-b9e4-244b822f683c}. >2012-08-07 14:47:25,326 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-18) VM 2842672f-6230-434f-8232-e88e71560092 managed non plugable device was removed unexpetedly from libvirt: VmId=2842672f-6230-434f-8232-e88e71560092,DeviceId=8cee58be-6fb1-4704-b9e4-244b822f683c,Device=memballoon,Type=balloon,BootOrder=0,SpecParams={model=virtio},Address={bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0},IsManaged=true,IsPlugged=true,IsReadOnly=true,alias=balloon0 >2012-08-07 14:47:25,349 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-18) Recieved a Device without an address when processing VM 6c1fcddf-86d6-4533-905b-abb11b775f5b devices, skipping device: {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=e6124933-39c7-4308-8e0e-8cd879d5a500}. >2012-08-07 14:47:25,360 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-18) VM 6c1fcddf-86d6-4533-905b-abb11b775f5b managed non plugable device was removed unexpetedly from libvirt: VmId=6c1fcddf-86d6-4533-905b-abb11b775f5b,DeviceId=e6124933-39c7-4308-8e0e-8cd879d5a500,Device=memballoon,Type=balloon,BootOrder=0,SpecParams={model=virtio},Address={bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0},IsManaged=true,IsPlugged=true,IsReadOnly=true,alias=balloon0 >2012-08-07 14:47:25,388 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-18) Recieved a Device without an address when processing VM 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 devices, skipping device: {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=b01f2bd9-52b1-40b4-903f-df536fe64518}. >2012-08-07 14:47:25,398 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-18) VM 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 managed non plugable device was removed unexpetedly from libvirt: VmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19,DeviceId=b01f2bd9-52b1-40b4-903f-df536fe64518,Device=memballoon,Type=balloon,BootOrder=0,SpecParams={model=virtio},Address={bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0},IsManaged=true,IsPlugged=true,IsReadOnly=true,alias=balloon0 >2012-08-07 14:47:25,425 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-18) Recieved a Device without an address when processing VM e5a192f1-3f9d-48e1-a817-28f72815c646 devices, skipping device: {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=0a89761f-fc5c-40bc-846f-bfc2e189cecf}. >2012-08-07 14:47:25,432 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-18) VM e5a192f1-3f9d-48e1-a817-28f72815c646 managed non plugable device was removed unexpetedly from libvirt: VmId=e5a192f1-3f9d-48e1-a817-28f72815c646,DeviceId=0a89761f-fc5c-40bc-846f-bfc2e189cecf,Device=memballoon,Type=balloon,BootOrder=0,SpecParams={model=virtio},Address={bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0},IsManaged=true,IsPlugged=true,IsReadOnly=true,alias=balloon0 >2012-08-07 14:47:25,823 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [410438f6] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42, vm=org.ovirt.engine.core.common.businessentities.VM@4153dbdd), log id: 378a4c4a >2012-08-07 14:47:26,096 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [410438f6] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42,devices=[Ljava.util.Map;@ea5d537,acpiEnable=true,vmName=pool1-11,cpuType=Conroe,custom={device_ebe823f7-b798-46c5-a793-2ec812c5e2d8device_e7b1f468-b662-4207-adc0-5f6f2a06fa4bdevice_e72e8938-b3be-4a17-bc37-fa2738ad8cf6device_5f53be23-e72e-4a66-88b1-0a64bf0acb46device_30f2fb52-100a-418a-a4e2-acb6f05e2944=VmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42,DeviceId=30f2fb52-100a-418a-a4e2-acb6f05e2944,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_ebe823f7-b798-46c5-a793-2ec812c5e2d8device_e7b1f468-b662-4207-adc0-5f6f2a06fa4b=VmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42,DeviceId=e7b1f468-b662-4207-adc0-5f6f2a06fa4b,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_ebe823f7-b798-46c5-a793-2ec812c5e2d8device_e7b1f468-b662-4207-adc0-5f6f2a06fa4bdevice_e72e8938-b3be-4a17-bc37-fa2738ad8cf6=VmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42,DeviceId=e72e8938-b3be-4a17-bc37-fa2738ad8cf6,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_ebe823f7-b798-46c5-a793-2ec812c5e2d8device_e7b1f468-b662-4207-adc0-5f6f2a06fa4bdevice_e72e8938-b3be-4a17-bc37-fa2738ad8cf6device_5f53be23-e72e-4a66-88b1-0a64bf0acb46=VmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42,DeviceId=5f53be23-e72e-4a66-88b1-0a64bf0acb46,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_ebe823f7-b798-46c5-a793-2ec812c5e2d8=VmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42,DeviceId=ebe823f7-b798-46c5-a793-2ec812c5e2d8,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0} >2012-08-07 14:47:26,132 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [410438f6] FINISH, CreateVDSCommand, log id: 378a4c4a >2012-08-07 14:47:26,143 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [410438f6] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 5. Vm: pool1-11 >2012-08-07 14:47:26,186 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [410438f6] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 6dbbc063 >2012-08-07 14:47:26,192 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) [410438f6] Before releasing a lock EngineLock [exclusiveLocks= key: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 value: VM >, sharedLocks= ] >2012-08-07 14:47:26,197 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) [410438f6] The exclusive lock for key 9dbe6b1e-2a98-449e-8bd7-2d025c420a42VM is released and lock is removed from map >2012-08-07 14:47:26,202 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [410438f6] Lock freed to object EngineLock [exclusiveLocks= key: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 value: VM >, sharedLocks= ] >2012-08-07 14:47:27,212 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:28,006 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-19) VM pool1-13 6c1fcddf-86d6-4533-905b-abb11b775f5b moved from WaitForLaunch --> PoweringUp >2012-08-07 14:47:28,007 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-19) VM pool1-14 2842672f-6230-434f-8232-e88e71560092 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:47:28,009 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-19) VM pool1-12 e5a192f1-3f9d-48e1-a817-28f72815c646 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:47:28,017 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-19) VM pool1-10 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:47:28,021 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-19) VM pool1-11 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:47:28,027 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-19) START, FullListVdsCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=null, vmIds=[6c1fcddf-86d6-4533-905b-abb11b775f5b, 2842672f-6230-434f-8232-e88e71560092, e5a192f1-3f9d-48e1-a817-28f72815c646, 6a729fb0-47fe-4eba-9ba3-2b939eee2b19]), log id: 657c75f0 >2012-08-07 14:47:28,074 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-19) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@4e23139d, log id: 657c75f0 >2012-08-07 14:47:30,276 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:32,210 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:35,638 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:37,221 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:40,666 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:42,211 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:44,244 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-48) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 14:47:44,246 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-48) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 14:47:44,247 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-48) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 14:47:44,248 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-48) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 14:47:45,313 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:47,212 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:50,397 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:52,210 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:55,281 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:47:57,216 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:00,386 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:00,400 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-30) [89ae2d3] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 14:48:00,411 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-30) [89ae2d3] FINISH, ConnectStorageServerVDSCommand, log id: 335c9fd0 >2012-08-07 14:48:00,418 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-30) [89ae2d3] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 14:48:00,558 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-57) [89ae2d3] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:48 PM >2012-08-07 14:48:00,559 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-57) [89ae2d3] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 6c67ade4 >2012-08-07 14:48:00,841 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-57) [89ae2d3] Failed in ActivateStorageDomainVDS method >2012-08-07 14:48:00,842 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-57) [89ae2d3] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:48:00,849 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) [89ae2d3] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:48:00,862 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-57) [89ae2d3] FINISH, ActivateStorageDomainVDSCommand, log id: 6c67ade4 >2012-08-07 14:48:00,868 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-57) [89ae2d3] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:48:00,881 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-57) [89ae2d3] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand.executeCommand(ActivateStorageDomainCommand.java:67) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteWithoutTransaction(CommandBase.java:810) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:901) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1256) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:168) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:107) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.Execute(CommandBase.java:916) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteAction(CommandBase.java:275) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:335) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:288) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.check(AutoRecoveryManager.java:96) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.onTimer(AutoRecoveryManager.java:63) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:64) [engine-scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz-2.1.2.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz-2.1.2.jar:] > >2012-08-07 14:48:01,092 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-57) [89ae2d3] Command [id=06516a5e-ba6c-405b-a08d-eb1ff7a411bb]: Going over compensation data. >2012-08-07 14:48:01,106 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-57) [89ae2d3] Command [id=06516a5e-ba6c-405b-a08d-eb1ff7a411bb]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 14:48:01,120 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) [89ae2d3] Checking autorecoverable storage domains done >2012-08-07 14:48:02,414 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:05,372 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:07,224 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:09,323 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Vms: sortby status asc) - entered >2012-08-07 14:48:09,324 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Vms: sortby status asc) - entered >2012-08-07 14:48:10,261 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:12,225 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:14,064 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8009-10) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ActivateStorageDomain, on Storage with id 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 14:48:14,078 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (ajp--127.0.0.1-8009-10) Before acquiring lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:48:14,085 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (ajp--127.0.0.1-8009-10) Successed acquiring lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] succeeded >2012-08-07 14:48:14,092 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8009-10) Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:48:14,201 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-30) [25824a46] Running command: ActivateStorageDomainCommand internal: false. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 14:48:14,226 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-30) [25824a46] Before releasing a lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:48:14,227 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-30) [25824a46] The exclusive lock for key 99bb665e-3421-4afb-bf70-d7b879c591b3STORAGE is released and lock is removed from map >2012-08-07 14:48:14,232 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-30) [25824a46] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:48:14,242 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-30) [25824a46] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:48 PM >2012-08-07 14:48:14,277 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [25824a46] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 59dac7d >2012-08-07 14:48:15,491 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:17,211 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:20,278 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:22,224 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:25,262 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:25,602 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-23) VM pool1-13 6c1fcddf-86d6-4533-905b-abb11b775f5b moved from PoweringUp --> Up >2012-08-07 14:48:25,605 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-23) VM pool1-14 2842672f-6230-434f-8232-e88e71560092 moved from PoweringUp --> Up >2012-08-07 14:48:25,611 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-23) VM pool1-12 e5a192f1-3f9d-48e1-a817-28f72815c646 moved from PoweringUp --> Up >2012-08-07 14:48:25,617 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-23) VM pool1-10 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 moved from PoweringUp --> Up >2012-08-07 14:48:25,752 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-23) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@e2cf35af), log id: 2cee7ca8 >2012-08-07 14:48:25,882 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-23) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 2cee7ca8 >2012-08-07 14:48:25,883 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-23) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 4. Vm: pool1-13 >2012-08-07 14:48:25,884 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-23) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 2,048. Vm: pool1-13 >2012-08-07 14:48:25,949 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-23) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@4a68d5d0), log id: 15418933 >2012-08-07 14:48:26,020 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-23) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 15418933 >2012-08-07 14:48:26,027 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-23) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 3. Vm: pool1-14 >2012-08-07 14:48:26,034 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-23) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 1,536. Vm: pool1-14 >2012-08-07 14:48:26,116 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-23) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@b20275f1), log id: f69147e >2012-08-07 14:48:26,140 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-23) FINISH, UpdateVdsDynamicDataVDSCommand, log id: f69147e >2012-08-07 14:48:26,145 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-23) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 2. Vm: pool1-12 >2012-08-07 14:48:26,151 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-23) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 1,024. Vm: pool1-12 >2012-08-07 14:48:26,181 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-23) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@199c1612), log id: 3a88a242 >2012-08-07 14:48:26,203 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-23) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 3a88a242 >2012-08-07 14:48:26,208 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-23) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 1. Vm: pool1-10 >2012-08-07 14:48:26,218 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-23) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 512. Vm: pool1-10 >2012-08-07 14:48:27,237 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:28,341 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-28) VM pool1-11 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 moved from PoweringUp --> Up >2012-08-07 14:48:28,368 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-28) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@8135b633), log id: 6da45700 >2012-08-07 14:48:28,389 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-28) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 6da45700 >2012-08-07 14:48:28,394 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-28) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 0. Vm: pool1-11 >2012-08-07 14:48:28,399 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-28) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 0. Vm: pool1-11 >2012-08-07 14:48:30,445 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:32,218 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:35,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:37,222 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:39,445 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-41) Start time: 8/7/12 2:48 PM. Start running CanDoAction for command number 1/6 (Command type: RunVm) >2012-08-07 14:48:39,446 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/7/12 2:48 PM. Start running CanDoAction for command number 2/6 (Command type: RunVm) >2012-08-07 14:48:39,447 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-29) Start time: 8/7/12 2:48 PM. Start running CanDoAction for command number 3/6 (Command type: RunVm) >2012-08-07 14:48:39,450 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/7/12 2:48 PM. Start running CanDoAction for command number 4/6 (Command type: RunVm) >2012-08-07 14:48:39,451 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/7/12 2:48 PM. Start running CanDoAction for command number 5/6 (Command type: RunVm) >2012-08-07 14:48:39,454 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-39) Start time: 8/7/12 2:48 PM. Start running CanDoAction for command number 6/6 (Command type: RunVm) >2012-08-07 14:48:39,467 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-29) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id c1cb365c-a119-493c-964c-faf65a10c889 >2012-08-07 14:48:39,477 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-39) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 6df57989-99a7-4ec9-8f7c-15f222064e61 >2012-08-07 14:48:39,476 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 3ce0f220-6cb8-42d8-b922-7003c60ccdad >2012-08-07 14:48:39,476 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-43) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id c7702cf0-88da-4885-9b9c-9e59772b3774 >2012-08-07 14:48:39,474 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 8738bb81-c73e-4a41-a24a-c4c49491c536 >2012-08-07 14:48:39,494 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-43) Before acquiring lock EngineLock [exclusiveLocks= key: c7702cf0-88da-4885-9b9c-9e59772b3774 value: VM >, sharedLocks= ] >2012-08-07 14:48:39,515 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-43) Successed acquiring lock EngineLock [exclusiveLocks= key: c7702cf0-88da-4885-9b9c-9e59772b3774 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:48:39,509 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-29) Before acquiring lock EngineLock [exclusiveLocks= key: c1cb365c-a119-493c-964c-faf65a10c889 value: VM >, sharedLocks= ] >2012-08-07 14:48:39,508 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 96405d4a-a3bd-4900-ab90-9c8736cb02a5 >2012-08-07 14:48:39,501 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) Before acquiring lock EngineLock [exclusiveLocks= key: 8738bb81-c73e-4a41-a24a-c4c49491c536 value: VM >, sharedLocks= ] >2012-08-07 14:48:39,496 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) Before acquiring lock EngineLock [exclusiveLocks= key: 3ce0f220-6cb8-42d8-b922-7003c60ccdad value: VM >, sharedLocks= ] >2012-08-07 14:48:39,496 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-39) Before acquiring lock EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-07 14:48:39,531 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-50) Before acquiring lock EngineLock [exclusiveLocks= key: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 value: VM >, sharedLocks= ] >2012-08-07 14:48:39,535 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-29) Successed acquiring lock EngineLock [exclusiveLocks= key: c1cb365c-a119-493c-964c-faf65a10c889 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:48:39,536 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-29) Lock Acquired to object EngineLock [exclusiveLocks= key: c1cb365c-a119-493c-964c-faf65a10c889 value: VM >, sharedLocks= ] >2012-08-07 14:48:39,536 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) Successed acquiring lock EngineLock [exclusiveLocks= key: 8738bb81-c73e-4a41-a24a-c4c49491c536 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:48:39,538 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) Lock Acquired to object EngineLock [exclusiveLocks= key: 8738bb81-c73e-4a41-a24a-c4c49491c536 value: VM >, sharedLocks= ] >2012-08-07 14:48:39,538 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) Successed acquiring lock EngineLock [exclusiveLocks= key: 3ce0f220-6cb8-42d8-b922-7003c60ccdad value: VM >, sharedLocks= ] succeeded >2012-08-07 14:48:39,539 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) Lock Acquired to object EngineLock [exclusiveLocks= key: 3ce0f220-6cb8-42d8-b922-7003c60ccdad value: VM >, sharedLocks= ] >2012-08-07 14:48:39,542 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-39) Successed acquiring lock EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:48:39,543 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-39) Lock Acquired to object EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-07 14:48:39,553 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-43) Lock Acquired to object EngineLock [exclusiveLocks= key: c7702cf0-88da-4885-9b9c-9e59772b3774 value: VM >, sharedLocks= ] >2012-08-07 14:48:39,571 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-41) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6af69d0f >2012-08-07 14:48:39,571 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-39) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1a9f1848 >2012-08-07 14:48:39,570 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-29) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 505d762f >2012-08-07 14:48:39,561 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-50) Successed acquiring lock EngineLock [exclusiveLocks= key: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:48:39,600 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) Lock Acquired to object EngineLock [exclusiveLocks= key: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 value: VM >, sharedLocks= ] >2012-08-07 14:48:39,602 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-29) FINISH, IsValidVDSCommand, return: true, log id: 505d762f >2012-08-07 14:48:39,604 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-39) FINISH, IsValidVDSCommand, return: true, log id: 1a9f1848 >2012-08-07 14:48:39,611 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-41) FINISH, IsValidVDSCommand, return: true, log id: 6af69d0f >2012-08-07 14:48:39,618 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 8e7b09d >2012-08-07 14:48:39,613 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 36a2f93e >2012-08-07 14:48:39,650 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) FINISH, IsValidVDSCommand, return: true, log id: 36a2f93e >2012-08-07 14:48:39,654 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) FINISH, IsValidVDSCommand, return: true, log id: 8e7b09d >2012-08-07 14:48:39,699 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-29) START, IsVmDuringInitiatingVDSCommand(vmId = c1cb365c-a119-493c-964c-faf65a10c889), log id: 7f5c0ee5 >2012-08-07 14:48:39,709 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-29) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 7f5c0ee5 >2012-08-07 14:48:39,714 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-39) START, IsVmDuringInitiatingVDSCommand(vmId = 6df57989-99a7-4ec9-8f7c-15f222064e61), log id: 15389200 >2012-08-07 14:48:39,723 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-39) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 15389200 >2012-08-07 14:48:39,727 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-39) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:48:39,738 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-39) Host Mem Conmmitted: 5,193, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:48:39,731 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-29) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:48:39,752 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-29) Host Mem Conmmitted: 5,193, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:48:39,754 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-29) 6,091 <= ??? 9,881 >2012-08-07 14:48:39,749 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 159d080a >2012-08-07 14:48:39,756 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-39) 6,091 <= ??? 9,881 >2012-08-07 14:48:39,765 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-29) End time: 8/7/12 2:48 PM. Finish handling CanDoAction for command number 3/6 (Command type: RunVm) >2012-08-07 14:48:39,762 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) FINISH, IsValidVDSCommand, return: true, log id: 159d080a >2012-08-07 14:48:39,770 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-39) End time: 8/7/12 2:48 PM. Finish handling CanDoAction for command number 6/6 (Command type: RunVm) >2012-08-07 14:48:39,768 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-43) START, IsVmDuringInitiatingVDSCommand(vmId = c7702cf0-88da-4885-9b9c-9e59772b3774), log id: 54bc39cf >2012-08-07 14:48:39,780 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-43) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 54bc39cf >2012-08-07 14:48:39,783 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-43) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:48:39,788 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) START, IsVmDuringInitiatingVDSCommand(vmId = 96405d4a-a3bd-4900-ab90-9c8736cb02a5), log id: 75e10fec >2012-08-07 14:48:39,790 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 75e10fec >2012-08-07 14:48:39,788 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-41) START, IsVmDuringInitiatingVDSCommand(vmId = 8738bb81-c73e-4a41-a24a-c4c49491c536), log id: 4a5301d2 >2012-08-07 14:48:39,792 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-41) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 4a5301d2 >2012-08-07 14:48:39,795 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:48:39,797 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-43) Host Mem Conmmitted: 5,193, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:48:39,797 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-50) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:48:39,813 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-50) Host Mem Conmmitted: 5,193, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:48:39,814 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-50) 6,091 <= ??? 9,881 >2012-08-07 14:48:39,808 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) Host Mem Conmmitted: 5,193, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:48:39,817 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) 6,091 <= ??? 9,881 >2012-08-07 14:48:39,818 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/7/12 2:48 PM. Finish handling CanDoAction for command number 2/6 (Command type: RunVm) >2012-08-07 14:48:39,817 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-43) 6,091 <= ??? 9,881 >2012-08-07 14:48:39,828 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-41) End time: 8/7/12 2:48 PM. Finish handling CanDoAction for command number 1/6 (Command type: RunVm) >2012-08-07 14:48:39,841 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/7/12 2:48 PM. Finish handling CanDoAction for command number 4/6 (Command type: RunVm) >2012-08-07 14:48:39,852 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) START, IsVmDuringInitiatingVDSCommand(vmId = 3ce0f220-6cb8-42d8-b922-7003c60ccdad), log id: 476e4a47 >2012-08-07 14:48:39,853 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 476e4a47 >2012-08-07 14:48:39,857 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:48:39,861 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) Host Mem Conmmitted: 5,193, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:48:39,867 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) 6,091 <= ??? 9,881 >2012-08-07 14:48:39,877 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/7/12 2:48 PM. Finish handling CanDoAction for command number 5/6 (Command type: RunVm) >2012-08-07 14:48:39,947 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [2fc6d10a] Running command: RunVmCommand internal: false. Entities affected : ID: 8738bb81-c73e-4a41-a24a-c4c49491c536 Type: VM >2012-08-07 14:48:39,961 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [2fc6d10a] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:48:39,966 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [2fc6d10a] Host Mem Conmmitted: 5,193, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:48:39,972 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [2fc6d10a] 6,091 <= ??? 9,881 >2012-08-07 14:48:39,995 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [2fc6d10a] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=8738bb81-c73e-4a41-a24a-c4c49491c536, vm=org.ovirt.engine.core.common.businessentities.VM@7906c3df), log id: 67ae9dfe >2012-08-07 14:48:39,999 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [2fc6d10a] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=8738bb81-c73e-4a41-a24a-c4c49491c536, vm=org.ovirt.engine.core.common.businessentities.VM@7906c3df), log id: 1713c4e9 >2012-08-07 14:48:40,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [2fc6d10a] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=8738bb81-c73e-4a41-a24a-c4c49491c536,devices=[Ljava.util.Map;@414f9387,acpiEnable=true,vmName=pool1-9,cpuType=Conroe,custom={device_121554a1-e556-4a4b-80e0-a11ff96fa37adevice_8208c7fd-22bf-4e76-a725-0240f8f03a4ddevice_2c234b62-f775-4c26-a9b5-9a4248f3c1c2=VmId=8738bb81-c73e-4a41-a24a-c4c49491c536,DeviceId=2c234b62-f775-4c26-a9b5-9a4248f3c1c2,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_121554a1-e556-4a4b-80e0-a11ff96fa37adevice_8208c7fd-22bf-4e76-a725-0240f8f03a4ddevice_2c234b62-f775-4c26-a9b5-9a4248f3c1c2device_53f8b25e-7874-4101-8587-316f649e3084device_1d9a9148-e8d4-41fb-a711-660c6357eac5=VmId=8738bb81-c73e-4a41-a24a-c4c49491c536,DeviceId=1d9a9148-e8d4-41fb-a711-660c6357eac5,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_121554a1-e556-4a4b-80e0-a11ff96fa37adevice_8208c7fd-22bf-4e76-a725-0240f8f03a4ddevice_2c234b62-f775-4c26-a9b5-9a4248f3c1c2device_53f8b25e-7874-4101-8587-316f649e3084=VmId=8738bb81-c73e-4a41-a24a-c4c49491c536,DeviceId=53f8b25e-7874-4101-8587-316f649e3084,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_121554a1-e556-4a4b-80e0-a11ff96fa37adevice_8208c7fd-22bf-4e76-a725-0240f8f03a4d=VmId=8738bb81-c73e-4a41-a24a-c4c49491c536,DeviceId=8208c7fd-22bf-4e76-a725-0240f8f03a4d,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_121554a1-e556-4a4b-80e0-a11ff96fa37a=VmId=8738bb81-c73e-4a41-a24a-c4c49491c536,DeviceId=121554a1-e556-4a4b-80e0-a11ff96fa37a,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0} >2012-08-07 14:48:40,160 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [2fc6d10a] FINISH, CreateVDSCommand, log id: 1713c4e9 >2012-08-07 14:48:40,175 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [2fc6d10a] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 1. Vm: pool1-9 >2012-08-07 14:48:40,231 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [2fc6d10a] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 67ae9dfe >2012-08-07 14:48:40,233 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) [2fc6d10a] Before releasing a lock EngineLock [exclusiveLocks= key: 8738bb81-c73e-4a41-a24a-c4c49491c536 value: VM >, sharedLocks= ] >2012-08-07 14:48:40,240 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) [2fc6d10a] The exclusive lock for key 8738bb81-c73e-4a41-a24a-c4c49491c536VM is released and lock is removed from map >2012-08-07 14:48:40,251 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [2fc6d10a] Lock freed to object EngineLock [exclusiveLocks= key: 8738bb81-c73e-4a41-a24a-c4c49491c536 value: VM >, sharedLocks= ] >2012-08-07 14:48:40,271 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:40,343 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [372116b0] Running command: RunVmCommand internal: false. Entities affected : ID: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 Type: VM >2012-08-07 14:48:40,357 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [372116b0] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 512 MB >2012-08-07 14:48:40,362 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [372116b0] Host Mem Conmmitted: 5,770, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:48:40,368 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [372116b0] 7,180 <= ??? 9,881 >2012-08-07 14:48:40,392 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [372116b0] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5, vm=org.ovirt.engine.core.common.businessentities.VM@1fda3d72), log id: 217d2833 >2012-08-07 14:48:40,405 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [372116b0] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5, vm=org.ovirt.engine.core.common.businessentities.VM@1fda3d72), log id: 7667f91a >2012-08-07 14:48:40,501 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [372116b0] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5,devices=[Ljava.util.Map;@294b4eb,acpiEnable=true,vmName=pool1-8,cpuType=Conroe,custom={device_88c05d62-1757-4ebf-b64b-3ada58aa08bcdevice_8d49f487-db9a-4c7a-8a4c-ca9a8c09aa7cdevice_5fb9e56e-c00d-499e-8282-abb8864e1ebcdevice_82470caf-7c25-4217-bb5f-88de7dd3159c=VmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5,DeviceId=82470caf-7c25-4217-bb5f-88de7dd3159c,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_88c05d62-1757-4ebf-b64b-3ada58aa08bcdevice_8d49f487-db9a-4c7a-8a4c-ca9a8c09aa7cdevice_5fb9e56e-c00d-499e-8282-abb8864e1ebc=VmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5,DeviceId=5fb9e56e-c00d-499e-8282-abb8864e1ebc,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_88c05d62-1757-4ebf-b64b-3ada58aa08bcdevice_8d49f487-db9a-4c7a-8a4c-ca9a8c09aa7cdevice_5fb9e56e-c00d-499e-8282-abb8864e1ebcdevice_82470caf-7c25-4217-bb5f-88de7dd3159cdevice_9bcf3857-e3aa-4e50-9e1e-d02f0ec2110c=VmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5,DeviceId=9bcf3857-e3aa-4e50-9e1e-d02f0ec2110c,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_88c05d62-1757-4ebf-b64b-3ada58aa08bcdevice_8d49f487-db9a-4c7a-8a4c-ca9a8c09aa7c=VmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5,DeviceId=8d49f487-db9a-4c7a-8a4c-ca9a8c09aa7c,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_88c05d62-1757-4ebf-b64b-3ada58aa08bc=VmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5,DeviceId=88c05d62-1757-4ebf-b64b-3ada58aa08bc,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0} >2012-08-07 14:48:40,560 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [372116b0] FINISH, CreateVDSCommand, log id: 7667f91a >2012-08-07 14:48:40,572 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [372116b0] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 2. Vm: pool1-8 >2012-08-07 14:48:40,897 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [372116b0] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 217d2833 >2012-08-07 14:48:40,903 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) [372116b0] Before releasing a lock EngineLock [exclusiveLocks= key: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 value: VM >, sharedLocks= ] >2012-08-07 14:48:40,910 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) [372116b0] The exclusive lock for key 96405d4a-a3bd-4900-ab90-9c8736cb02a5VM is released and lock is removed from map >2012-08-07 14:48:40,917 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [372116b0] Lock freed to object EngineLock [exclusiveLocks= key: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 value: VM >, sharedLocks= ] >2012-08-07 14:48:41,154 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [19625e98] Running command: RunVmCommand internal: false. Entities affected : ID: c1cb365c-a119-493c-964c-faf65a10c889 Type: VM >2012-08-07 14:48:41,166 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [19625e98] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 1,024 MB >2012-08-07 14:48:41,171 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [19625e98] Host Mem Conmmitted: 6,347, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:48:41,180 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [19625e98] 8,269 <= ??? 9,881 >2012-08-07 14:48:41,238 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [19625e98] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=c1cb365c-a119-493c-964c-faf65a10c889, vm=org.ovirt.engine.core.common.businessentities.VM@384e2825), log id: 12741c2 >2012-08-07 14:48:41,245 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [19625e98] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=c1cb365c-a119-493c-964c-faf65a10c889, vm=org.ovirt.engine.core.common.businessentities.VM@384e2825), log id: 4777767b >2012-08-07 14:48:41,523 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [19625e98] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=c1cb365c-a119-493c-964c-faf65a10c889,devices=[Ljava.util.Map;@6d1d183,acpiEnable=true,vmName=pool1-5,cpuType=Conroe,custom={device_58f19f9a-b63b-4b20-8f27-e9356cd5bca4device_fb28fb73-132c-420d-b0fb-65bd5336b670=VmId=c1cb365c-a119-493c-964c-faf65a10c889,DeviceId=fb28fb73-132c-420d-b0fb-65bd5336b670,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_58f19f9a-b63b-4b20-8f27-e9356cd5bca4device_fb28fb73-132c-420d-b0fb-65bd5336b670device_6e2de17e-02fa-4e80-bd2d-8ae4c66ac807device_d10b3167-a210-4b20-bbe5-971cbe2659e8device_fbd9fccc-443c-4b53-88db-da873ecc89a5=VmId=c1cb365c-a119-493c-964c-faf65a10c889,DeviceId=fbd9fccc-443c-4b53-88db-da873ecc89a5,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_58f19f9a-b63b-4b20-8f27-e9356cd5bca4device_fb28fb73-132c-420d-b0fb-65bd5336b670device_6e2de17e-02fa-4e80-bd2d-8ae4c66ac807device_d10b3167-a210-4b20-bbe5-971cbe2659e8=VmId=c1cb365c-a119-493c-964c-faf65a10c889,DeviceId=d10b3167-a210-4b20-bbe5-971cbe2659e8,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_58f19f9a-b63b-4b20-8f27-e9356cd5bca4device_fb28fb73-132c-420d-b0fb-65bd5336b670device_6e2de17e-02fa-4e80-bd2d-8ae4c66ac807=VmId=c1cb365c-a119-493c-964c-faf65a10c889,DeviceId=6e2de17e-02fa-4e80-bd2d-8ae4c66ac807,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_58f19f9a-b63b-4b20-8f27-e9356cd5bca4=VmId=c1cb365c-a119-493c-964c-faf65a10c889,DeviceId=58f19f9a-b63b-4b20-8f27-e9356cd5bca4,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0} >2012-08-07 14:48:41,603 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [19625e98] FINISH, CreateVDSCommand, log id: 4777767b >2012-08-07 14:48:41,617 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [19625e98] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 3. Vm: pool1-5 >2012-08-07 14:48:41,716 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [19625e98] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 12741c2 >2012-08-07 14:48:41,722 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) [19625e98] Before releasing a lock EngineLock [exclusiveLocks= key: c1cb365c-a119-493c-964c-faf65a10c889 value: VM >, sharedLocks= ] >2012-08-07 14:48:41,729 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) [19625e98] The exclusive lock for key c1cb365c-a119-493c-964c-faf65a10c889VM is released and lock is removed from map >2012-08-07 14:48:41,736 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [19625e98] Lock freed to object EngineLock [exclusiveLocks= key: c1cb365c-a119-493c-964c-faf65a10c889 value: VM >, sharedLocks= ] >2012-08-07 14:48:42,238 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [52ace8d] Running command: RunVmCommand internal: false. Entities affected : ID: c7702cf0-88da-4885-9b9c-9e59772b3774 Type: VM >2012-08-07 14:48:42,254 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [52ace8d] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 1,536 MB >2012-08-07 14:48:42,263 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [52ace8d] Host Mem Conmmitted: 6,924, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:48:42,272 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [52ace8d] 9,358 <= ??? 9,881 >2012-08-07 14:48:42,305 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:42,368 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [52ace8d] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=c7702cf0-88da-4885-9b9c-9e59772b3774, vm=org.ovirt.engine.core.common.businessentities.VM@7583fc65), log id: 1eaf092f >2012-08-07 14:48:42,373 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [52ace8d] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=c7702cf0-88da-4885-9b9c-9e59772b3774, vm=org.ovirt.engine.core.common.businessentities.VM@7583fc65), log id: 7a2fc815 >2012-08-07 14:48:42,468 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [52ace8d] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=c7702cf0-88da-4885-9b9c-9e59772b3774,devices=[Ljava.util.Map;@532f2f2a,acpiEnable=true,vmName=pool1-6,cpuType=Conroe,custom={device_a4c7aa56-9bc1-44c7-be30-f134dd9314ecdevice_049e0b63-64ee-4da5-8d54-bee48a5a6cef=VmId=c7702cf0-88da-4885-9b9c-9e59772b3774,DeviceId=049e0b63-64ee-4da5-8d54-bee48a5a6cef,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_a4c7aa56-9bc1-44c7-be30-f134dd9314ecdevice_049e0b63-64ee-4da5-8d54-bee48a5a6cefdevice_050a9d45-d79e-4652-b045-49f032bff7fddevice_1c96937d-5875-43bf-960a-e320939476e5device_de5b2d53-0fc2-4222-a6bd-fa4ac688138e=VmId=c7702cf0-88da-4885-9b9c-9e59772b3774,DeviceId=de5b2d53-0fc2-4222-a6bd-fa4ac688138e,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_a4c7aa56-9bc1-44c7-be30-f134dd9314ec=VmId=c7702cf0-88da-4885-9b9c-9e59772b3774,DeviceId=a4c7aa56-9bc1-44c7-be30-f134dd9314ec,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_a4c7aa56-9bc1-44c7-be30-f134dd9314ecdevice_049e0b63-64ee-4da5-8d54-bee48a5a6cefdevice_050a9d45-d79e-4652-b045-49f032bff7fddevice_1c96937d-5875-43bf-960a-e320939476e5=VmId=c7702cf0-88da-4885-9b9c-9e59772b3774,DeviceId=1c96937d-5875-43bf-960a-e320939476e5,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_a4c7aa56-9bc1-44c7-be30-f134dd9314ecdevice_049e0b63-64ee-4da5-8d54-bee48a5a6cefdevice_050a9d45-d79e-4652-b045-49f032bff7fd=VmId=c7702cf0-88da-4885-9b9c-9e59772b3774,DeviceId=050a9d45-d79e-4652-b045-49f032bff7fd,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0} >2012-08-07 14:48:42,531 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-41) [52ace8d] FINISH, CreateVDSCommand, log id: 7a2fc815 >2012-08-07 14:48:42,540 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [52ace8d] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 4. Vm: pool1-6 >2012-08-07 14:48:42,642 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-41) [52ace8d] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 1eaf092f >2012-08-07 14:48:42,647 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) [52ace8d] Before releasing a lock EngineLock [exclusiveLocks= key: c7702cf0-88da-4885-9b9c-9e59772b3774 value: VM >, sharedLocks= ] >2012-08-07 14:48:42,654 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) [52ace8d] The exclusive lock for key c7702cf0-88da-4885-9b9c-9e59772b3774VM is released and lock is removed from map >2012-08-07 14:48:42,660 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [52ace8d] Lock freed to object EngineLock [exclusiveLocks= key: c7702cf0-88da-4885-9b9c-9e59772b3774 value: VM >, sharedLocks= ] >2012-08-07 14:48:42,817 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [1b42bf75] Running command: RunVmCommand internal: false. Entities affected : ID: 3ce0f220-6cb8-42d8-b922-7003c60ccdad Type: VM >2012-08-07 14:48:42,831 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [1b42bf75] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 2,048 MB >2012-08-07 14:48:42,836 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [1b42bf75] Host Mem Conmmitted: 7,501, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:48:42,842 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [1b42bf75] 10,447 <= ??? 9,881 >2012-08-07 14:48:42,845 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [1b42bf75] Cant find VDS to run the VM 3ce0f220-6cb8-42d8-b922-7003c60ccdad on, so this VM will not be run. >2012-08-07 14:48:42,885 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [1b42bf75] Command [id=36190f05-609a-488d-ac71-15bf345a2772]: No compensation data. >2012-08-07 14:48:42,891 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) [1b42bf75] Before releasing a lock EngineLock [exclusiveLocks= key: 3ce0f220-6cb8-42d8-b922-7003c60ccdad value: VM >, sharedLocks= ] >2012-08-07 14:48:42,898 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) [1b42bf75] The exclusive lock for key 3ce0f220-6cb8-42d8-b922-7003c60ccdadVM is released and lock is removed from map >2012-08-07 14:48:42,907 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [1b42bf75] Lock freed to object EngineLock [exclusiveLocks= key: 3ce0f220-6cb8-42d8-b922-7003c60ccdad value: VM >, sharedLocks= ] >2012-08-07 14:48:43,035 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [6180669f] Running command: RunVmCommand internal: false. Entities affected : ID: 6df57989-99a7-4ec9-8f7c-15f222064e61 Type: VM >2012-08-07 14:48:43,049 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [6180669f] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 2,048 MB >2012-08-07 14:48:43,054 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [6180669f] Host Mem Conmmitted: 7,501, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:48:43,059 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) [6180669f] 10,447 <= ??? 9,881 >2012-08-07 14:48:43,063 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [6180669f] Cant find VDS to run the VM 6df57989-99a7-4ec9-8f7c-15f222064e61 on, so this VM will not be run. >2012-08-07 14:48:43,113 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [6180669f] Command [id=aefade45-3057-45ba-9b39-f42f796ce90a]: No compensation data. >2012-08-07 14:48:43,115 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) [6180669f] Before releasing a lock EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-07 14:48:43,128 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) [6180669f] The exclusive lock for key 6df57989-99a7-4ec9-8f7c-15f222064e61VM is released and lock is removed from map >2012-08-07 14:48:43,141 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) [6180669f] Lock freed to object EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-07 14:48:43,248 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-54) VM pool1-8 96405d4a-a3bd-4900-ab90-9c8736cb02a5 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:48:43,249 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-54) VM pool1-9 8738bb81-c73e-4a41-a24a-c4c49491c536 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:48:43,252 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-54) VM pool1-5 c1cb365c-a119-493c-964c-faf65a10c889 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:48:43,259 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-54) START, FullListVdsCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=null, vmIds=[c7702cf0-88da-4885-9b9c-9e59772b3774, 96405d4a-a3bd-4900-ab90-9c8736cb02a5, 8738bb81-c73e-4a41-a24a-c4c49491c536, c1cb365c-a119-493c-964c-faf65a10c889]), log id: 770518c4 >2012-08-07 14:48:43,368 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-54) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@6f9d28e7, log id: 770518c4 >2012-08-07 14:48:44,253 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-61) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 14:48:44,259 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-61) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 14:48:44,260 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-61) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 14:48:44,261 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-61) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 14:48:45,245 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:45,888 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-64) VM pool1-6 c7702cf0-88da-4885-9b9c-9e59772b3774 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:48:45,889 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-64) START, FullListVdsCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=null, vmIds=[c7702cf0-88da-4885-9b9c-9e59772b3774]), log id: 78d9234e >2012-08-07 14:48:45,930 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-64) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@7710bfb, log id: 78d9234e >2012-08-07 14:48:47,226 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:50,280 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:52,229 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:55,265 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:48:57,214 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:00,407 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:02,215 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:05,301 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:07,216 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:10,270 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:10,456 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Vms: sortby name) - entered >2012-08-07 14:49:12,213 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:15,280 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:17,224 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:20,271 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:21,181 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 1/7 (Command type: ShutdownVm) >2012-08-07 14:49:21,184 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 7/7 (Command type: ShutdownVm) >2012-08-07 14:49:21,183 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 6/7 (Command type: ShutdownVm) >2012-08-07 14:49:21,183 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-39) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 5/7 (Command type: ShutdownVm) >2012-08-07 14:49:21,183 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 2/7 (Command type: ShutdownVm) >2012-08-07 14:49:21,183 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-29) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 4/7 (Command type: ShutdownVm) >2012-08-07 14:49:21,183 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 3/7 (Command type: ShutdownVm) >2012-08-07 14:49:21,209 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 >2012-08-07 14:49:21,221 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 >2012-08-07 14:49:21,221 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-48) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 5524b98a-aa45-49cb-9d8b-bec3884753c9 >2012-08-07 14:49:21,218 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 2842672f-6230-434f-8232-e88e71560092 >2012-08-07 14:49:21,216 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id e5a192f1-3f9d-48e1-a817-28f72815c646 >2012-08-07 14:49:21,214 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 6c1fcddf-86d6-4533-905b-abb11b775f5b >2012-08-07 14:49:21,240 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-43) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 3c7c0453-5f05-4314-bdd4-eb4fd243f80a >2012-08-07 14:49:21,257 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 6/7 (Command type: ShutdownVm) >2012-08-07 14:49:21,292 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 3/7 (Command type: ShutdownVm) >2012-08-07 14:49:21,293 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-29) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 4/7 (Command type: ShutdownVm) >2012-08-07 14:49:21,294 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 7/7 (Command type: ShutdownVm) >2012-08-07 14:49:21,297 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 1/7 (Command type: ShutdownVm) >2012-08-07 14:49:21,363 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 2/7 (Command type: ShutdownVm) >2012-08-07 14:49:21,382 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-39) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 5/7 (Command type: ShutdownVm) >2012-08-07 14:49:21,464 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) [5054a540] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 3c7c0453-5f05-4314-bdd4-eb4fd243f80a Type: VM >2012-08-07 14:49:21,468 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) [5054a540] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-1). >2012-08-07 14:49:21,478 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) [5054a540] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-1. >2012-08-07 14:49:21,493 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-39) [5054a540] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=3c7c0453-5f05-4314-bdd4-eb4fd243f80a, force=false, secondsToWait=30, gracefully=true), log id: 6c4ce7e1 >2012-08-07 14:49:21,566 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-39) [5054a540] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=3c7c0453-5f05-4314-bdd4-eb4fd243f80a, force=false, secondsToWait=30, gracefully=true), log id: 3ac43774 >2012-08-07 14:49:21,643 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-39) [5054a540] FINISH, DestroyVDSCommand, log id: 3ac43774 >2012-08-07 14:49:21,662 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-39) [5054a540] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 6c4ce7e1 >2012-08-07 14:49:21,776 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) [652d35f3] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 Type: VM >2012-08-07 14:49:21,784 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) [652d35f3] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-10). >2012-08-07 14:49:21,790 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) [652d35f3] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-10. >2012-08-07 14:49:21,795 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-39) [652d35f3] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, force=false, secondsToWait=30, gracefully=true), log id: 1ed1c93b >2012-08-07 14:49:21,808 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-39) [652d35f3] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, force=false, secondsToWait=30, gracefully=true), log id: 7dee42dc >2012-08-07 14:49:21,872 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-39) [652d35f3] FINISH, DestroyVDSCommand, log id: 7dee42dc >2012-08-07 14:49:21,893 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-39) [652d35f3] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 1ed1c93b >2012-08-07 14:49:22,021 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) [7b311869] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 Type: VM >2012-08-07 14:49:22,029 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) [7b311869] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-11). >2012-08-07 14:49:22,034 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) [7b311869] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-11. >2012-08-07 14:49:22,039 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-39) [7b311869] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42, force=false, secondsToWait=30, gracefully=true), log id: 4cfb5deb >2012-08-07 14:49:22,053 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-39) [7b311869] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42, force=false, secondsToWait=30, gracefully=true), log id: 449341a6 >2012-08-07 14:49:22,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-39) [7b311869] FINISH, DestroyVDSCommand, log id: 449341a6 >2012-08-07 14:49:22,156 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-39) [7b311869] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 4cfb5deb >2012-08-07 14:49:22,232 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) [5439d4ae] Running command: ShutdownVmCommand internal: false. Entities affected : ID: e5a192f1-3f9d-48e1-a817-28f72815c646 Type: VM >2012-08-07 14:49:22,246 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) [5439d4ae] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-12). >2012-08-07 14:49:22,252 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) [5439d4ae] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-12. >2012-08-07 14:49:22,260 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-39) [5439d4ae] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, force=false, secondsToWait=30, gracefully=true), log id: 692f4773 >2012-08-07 14:49:22,273 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-39) [5439d4ae] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, force=false, secondsToWait=30, gracefully=true), log id: 79c82567 >2012-08-07 14:49:22,347 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-39) [5439d4ae] FINISH, DestroyVDSCommand, log id: 79c82567 >2012-08-07 14:49:22,358 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:22,391 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-39) [5439d4ae] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 692f4773 >2012-08-07 14:49:22,515 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) [20ba16b5] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 6c1fcddf-86d6-4533-905b-abb11b775f5b Type: VM >2012-08-07 14:49:22,523 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) [20ba16b5] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-13). >2012-08-07 14:49:22,528 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) [20ba16b5] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-13. >2012-08-07 14:49:22,539 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-39) [20ba16b5] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, force=false, secondsToWait=30, gracefully=true), log id: 991e1f5 >2012-08-07 14:49:22,557 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-39) [20ba16b5] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, force=false, secondsToWait=30, gracefully=true), log id: 554eadfe >2012-08-07 14:49:22,642 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-39) [20ba16b5] FINISH, DestroyVDSCommand, log id: 554eadfe >2012-08-07 14:49:22,662 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-39) [20ba16b5] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 991e1f5 >2012-08-07 14:49:22,764 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) [1928d5dc] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 2842672f-6230-434f-8232-e88e71560092 Type: VM >2012-08-07 14:49:22,766 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) [1928d5dc] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-14). >2012-08-07 14:49:22,775 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) [1928d5dc] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-14. >2012-08-07 14:49:22,787 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-39) [1928d5dc] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, force=false, secondsToWait=30, gracefully=true), log id: 5e86886 >2012-08-07 14:49:22,813 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-39) [1928d5dc] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, force=false, secondsToWait=30, gracefully=true), log id: 2de72b73 >2012-08-07 14:49:22,894 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-39) [1928d5dc] FINISH, DestroyVDSCommand, log id: 2de72b73 >2012-08-07 14:49:22,910 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-39) [1928d5dc] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 5e86886 >2012-08-07 14:49:23,009 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) [3693d23c] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 5524b98a-aa45-49cb-9d8b-bec3884753c9 Type: VM >2012-08-07 14:49:23,021 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 1/7 (Command type: ShutdownVm) >2012-08-07 14:49:23,025 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-29) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 2/7 (Command type: ShutdownVm) >2012-08-07 14:49:23,030 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 >2012-08-07 14:49:23,036 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 3c7c0453-5f05-4314-bdd4-eb4fd243f80a >2012-08-07 14:49:23,036 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) [3693d23c] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-15). >2012-08-07 14:49:23,036 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 7/7 (Command type: ShutdownVm) >2012-08-07 14:49:23,035 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 6/7 (Command type: ShutdownVm) >2012-08-07 14:49:23,035 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 5/7 (Command type: ShutdownVm) >2012-08-07 14:49:23,035 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 4/7 (Command type: ShutdownVm) >2012-08-07 14:49:23,035 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 3/7 (Command type: ShutdownVm) >2012-08-07 14:49:23,060 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-48) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id e5a192f1-3f9d-48e1-a817-28f72815c646 >2012-08-07 14:49:23,075 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-43) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 >2012-08-07 14:49:23,071 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 6c1fcddf-86d6-4533-905b-abb11b775f5b >2012-08-07 14:49:23,067 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 5524b98a-aa45-49cb-9d8b-bec3884753c9 >2012-08-07 14:49:23,067 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 2842672f-6230-434f-8232-e88e71560092 >2012-08-07 14:49:23,063 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) [3693d23c] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-15. >2012-08-07 14:49:23,086 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-39) [3693d23c] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=5524b98a-aa45-49cb-9d8b-bec3884753c9, force=false, secondsToWait=30, gracefully=true), log id: 4b488bbc >2012-08-07 14:49:23,091 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 6/7 (Command type: ShutdownVm) >2012-08-07 14:49:23,119 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 3/7 (Command type: ShutdownVm) >2012-08-07 14:49:23,118 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-39) [3693d23c] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=5524b98a-aa45-49cb-9d8b-bec3884753c9, force=false, secondsToWait=30, gracefully=true), log id: 4749aaf1 >2012-08-07 14:49:23,113 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 4/7 (Command type: ShutdownVm) >2012-08-07 14:49:23,102 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 7/7 (Command type: ShutdownVm) >2012-08-07 14:49:23,100 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 5/7 (Command type: ShutdownVm) >2012-08-07 14:49:23,100 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-29) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 2/7 (Command type: ShutdownVm) >2012-08-07 14:49:23,168 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 1/7 (Command type: ShutdownVm) >2012-08-07 14:49:23,212 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-39) [3693d23c] FINISH, DestroyVDSCommand, log id: 4749aaf1 >2012-08-07 14:49:23,235 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-39) [3693d23c] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 4b488bbc >2012-08-07 14:49:23,309 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [3e3fccea] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 3c7c0453-5f05-4314-bdd4-eb4fd243f80a Type: VM >2012-08-07 14:49:23,312 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [3e3fccea] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-1). >2012-08-07 14:49:23,319 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [3e3fccea] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-1, status is not up. Stopping instead. >2012-08-07 14:49:23,336 DEBUG [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-50) [47a0ded5] Permission check skipped for internal action StopVm. >2012-08-07 14:49:23,343 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-50) [47a0ded5] Running command: StopVmCommand internal: true. Entities affected : ID: 3c7c0453-5f05-4314-bdd4-eb4fd243f80a Type: VM >2012-08-07 14:49:23,355 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [47a0ded5] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=3c7c0453-5f05-4314-bdd4-eb4fd243f80a, force=false, secondsToWait=0, gracefully=false), log id: 32fae0c8 >2012-08-07 14:49:23,374 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [47a0ded5] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=3c7c0453-5f05-4314-bdd4-eb4fd243f80a, force=false, secondsToWait=0, gracefully=false), log id: 68bf4c48 >2012-08-07 14:49:23,768 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [47a0ded5] FINISH, DestroyVDSCommand, log id: 68bf4c48 >2012-08-07 14:49:23,805 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [47a0ded5] FINISH, DestroyVmVDSCommand, return: Down, log id: 32fae0c8 >2012-08-07 14:49:23,928 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [4ea63693] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 Type: VM >2012-08-07 14:49:23,931 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [4ea63693] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-10). >2012-08-07 14:49:23,938 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [4ea63693] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-10, status is not up. Stopping instead. >2012-08-07 14:49:23,961 DEBUG [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-50) [19dc463b] Permission check skipped for internal action StopVm. >2012-08-07 14:49:23,970 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-50) [19dc463b] Running command: StopVmCommand internal: true. Entities affected : ID: 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 Type: VM >2012-08-07 14:49:23,982 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [19dc463b] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, force=false, secondsToWait=0, gracefully=false), log id: 47bc9bba >2012-08-07 14:49:24,244 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [19dc463b] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6a729fb0-47fe-4eba-9ba3-2b939eee2b19, force=false, secondsToWait=0, gracefully=false), log id: 5db8461f >2012-08-07 14:49:24,600 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [19dc463b] FINISH, DestroyVDSCommand, log id: 5db8461f >2012-08-07 14:49:24,642 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [19dc463b] FINISH, DestroyVmVDSCommand, return: Down, log id: 47bc9bba >2012-08-07 14:49:24,760 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [249153c] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 Type: VM >2012-08-07 14:49:24,772 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [249153c] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-11). >2012-08-07 14:49:24,780 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [249153c] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-11, status is not up. Stopping instead. >2012-08-07 14:49:24,790 DEBUG [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-50) [2ec0c2b8] Permission check skipped for internal action StopVm. >2012-08-07 14:49:24,802 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-50) [2ec0c2b8] Running command: StopVmCommand internal: true. Entities affected : ID: 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 Type: VM >2012-08-07 14:49:24,828 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [2ec0c2b8] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42, force=false, secondsToWait=0, gracefully=false), log id: 7aab5c60 >2012-08-07 14:49:24,865 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [2ec0c2b8] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=9dbe6b1e-2a98-449e-8bd7-2d025c420a42, force=false, secondsToWait=0, gracefully=false), log id: 5324c86f >2012-08-07 14:49:25,271 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [2ec0c2b8] FINISH, DestroyVDSCommand, log id: 5324c86f >2012-08-07 14:49:25,332 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [2ec0c2b8] FINISH, DestroyVmVDSCommand, return: Down, log id: 7aab5c60 >2012-08-07 14:49:25,493 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [c111750] Running command: ShutdownVmCommand internal: false. Entities affected : ID: e5a192f1-3f9d-48e1-a817-28f72815c646 Type: VM >2012-08-07 14:49:25,495 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [c111750] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-12). >2012-08-07 14:49:25,502 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [c111750] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-12, status is not up. Stopping instead. >2012-08-07 14:49:25,516 DEBUG [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-50) [688401c9] Permission check skipped for internal action StopVm. >2012-08-07 14:49:25,527 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-50) [688401c9] Running command: StopVmCommand internal: true. Entities affected : ID: e5a192f1-3f9d-48e1-a817-28f72815c646 Type: VM >2012-08-07 14:49:25,537 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [688401c9] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, force=false, secondsToWait=0, gracefully=false), log id: 272f6c75 >2012-08-07 14:49:25,564 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [688401c9] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, force=false, secondsToWait=0, gracefully=false), log id: 405ca501 >2012-08-07 14:49:25,570 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:25,937 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [688401c9] FINISH, DestroyVDSCommand, log id: 405ca501 >2012-08-07 14:49:25,968 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [688401c9] FINISH, DestroyVmVDSCommand, return: Down, log id: 272f6c75 >2012-08-07 14:49:25,989 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-29) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 1/7 (Command type: ShutdownVm) >2012-08-07 14:49:25,997 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-39) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 2/7 (Command type: ShutdownVm) >2012-08-07 14:49:26,004 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 3/7 (Command type: ShutdownVm) >2012-08-07 14:49:26,009 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 9dbe6b1e-2a98-449e-8bd7-2d025c420a42 >2012-08-07 14:49:26,018 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 3c7c0453-5f05-4314-bdd4-eb4fd243f80a >2012-08-07 14:49:26,013 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 6a729fb0-47fe-4eba-9ba3-2b939eee2b19 >2012-08-07 14:49:26,013 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 7/7 (Command type: ShutdownVm) >2012-08-07 14:49:26,013 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 6/7 (Command type: ShutdownVm) >2012-08-07 14:49:26,012 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 5/7 (Command type: ShutdownVm) >2012-08-07 14:49:26,012 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 4/7 (Command type: ShutdownVm) >2012-08-07 14:49:26,044 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id e5a192f1-3f9d-48e1-a817-28f72815c646 >2012-08-07 14:49:26,045 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-48) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 6c1fcddf-86d6-4533-905b-abb11b775f5b >2012-08-07 14:49:26,051 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 2842672f-6230-434f-8232-e88e71560092 >2012-08-07 14:49:26,077 WARN [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) CanDoAction of action ShutdownVm failed. Reasons:ACTION_TYPE_FAILED_VM_IS_NOT_RUNNING,VAR__ACTION__SHUTDOWN,VAR__TYPE__VM >2012-08-07 14:49:26,076 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 5/7 (Command type: ShutdownVm) >2012-08-07 14:49:26,073 WARN [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) CanDoAction of action ShutdownVm failed. Reasons:ACTION_TYPE_FAILED_VM_IS_NOT_RUNNING,VAR__ACTION__SHUTDOWN,VAR__TYPE__VM >2012-08-07 14:49:26,070 WARN [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) CanDoAction of action ShutdownVm failed. Reasons:ACTION_TYPE_FAILED_VM_IS_NOT_RUNNING,VAR__ACTION__SHUTDOWN,VAR__TYPE__VM >2012-08-07 14:49:26,066 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-43) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 5524b98a-aa45-49cb-9d8b-bec3884753c9 >2012-08-07 14:49:26,057 WARN [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-39) CanDoAction of action ShutdownVm failed. Reasons:ACTION_TYPE_FAILED_VM_IS_NOT_RUNNING,VAR__ACTION__SHUTDOWN,VAR__TYPE__VM >2012-08-07 14:49:26,106 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-39) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 2/7 (Command type: ShutdownVm) >2012-08-07 14:49:26,102 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 3/7 (Command type: ShutdownVm) >2012-08-07 14:49:26,101 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-29) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 1/7 (Command type: ShutdownVm) >2012-08-07 14:49:26,112 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 7/7 (Command type: ShutdownVm) >2012-08-07 14:49:26,116 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 6/7 (Command type: ShutdownVm) >2012-08-07 14:49:26,113 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 4/7 (Command type: ShutdownVm) >2012-08-07 14:49:26,150 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [36118b60] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 6c1fcddf-86d6-4533-905b-abb11b775f5b Type: VM >2012-08-07 14:49:26,154 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [36118b60] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-13). >2012-08-07 14:49:26,162 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [36118b60] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-13, status is not up. Stopping instead. >2012-08-07 14:49:26,181 DEBUG [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-50) [31d76b45] Permission check skipped for internal action StopVm. >2012-08-07 14:49:26,189 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-50) [31d76b45] Running command: StopVmCommand internal: true. Entities affected : ID: 6c1fcddf-86d6-4533-905b-abb11b775f5b Type: VM >2012-08-07 14:49:26,192 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) [12af7acb] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 6c1fcddf-86d6-4533-905b-abb11b775f5b Type: VM >2012-08-07 14:49:26,200 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) [12af7acb] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-13). >2012-08-07 14:49:26,207 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) [12af7acb] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-13, status is not up. Stopping instead. >2012-08-07 14:49:26,206 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [31d76b45] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, force=false, secondsToWait=0, gracefully=false), log id: 4a1588b5 >2012-08-07 14:49:26,220 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [31d76b45] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, force=false, secondsToWait=0, gracefully=false), log id: 60b43093 >2012-08-07 14:49:26,223 DEBUG [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-29) [47b39cf2] Permission check skipped for internal action StopVm. >2012-08-07 14:49:26,232 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-29) [47b39cf2] Running command: StopVmCommand internal: true. Entities affected : ID: 6c1fcddf-86d6-4533-905b-abb11b775f5b Type: VM >2012-08-07 14:49:26,249 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-29) [47b39cf2] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, force=false, secondsToWait=0, gracefully=false), log id: 5c8c2c21 >2012-08-07 14:49:26,628 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [31d76b45] FINISH, DestroyVDSCommand, log id: 60b43093 >2012-08-07 14:49:26,676 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [31d76b45] FINISH, DestroyVmVDSCommand, return: Down, log id: 4a1588b5 >2012-08-07 14:49:26,678 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-29) [47b39cf2] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, force=false, secondsToWait=0, gracefully=false), log id: 32c5ab8a >2012-08-07 14:49:26,706 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-29) [47b39cf2] Failed in DestroyVDS method >2012-08-07 14:49:26,707 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-29) [47b39cf2] Error code noVM and error message VDSGenericException: VDSErrorException: Failed to DestroyVDS, error = Virtual machine does not exist >2012-08-07 14:49:26,723 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-29) [47b39cf2] Command org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand return value > Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusOnlyReturnForXmlRpc >mStatus Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc >mCode 1 >mMessage Virtual machine does not exist > > >2012-08-07 14:49:26,744 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-29) [47b39cf2] Vds: purple-vds2 >2012-08-07 14:49:26,753 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-29) [47b39cf2] Command DestroyVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to DestroyVDS, error = Virtual machine does not exist >2012-08-07 14:49:26,764 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-29) [47b39cf2] FINISH, DestroyVDSCommand, log id: 32c5ab8a >2012-08-07 14:49:26,772 ERROR [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-29) [47b39cf2] VDS::destroy Failed destroying vm 6c1fcddf-86d6-4533-905b-abb11b775f5b in vds = 4196a566-dee6-11e1-b66e-c35c5273fee7 : purple-vds2, error = org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to DestroyVDS, error = Virtual machine does not exist >2012-08-07 14:49:26,795 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-29) [47b39cf2] FINISH, DestroyVmVDSCommand, log id: 5c8c2c21 >2012-08-07 14:49:26,805 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [39d5675b] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 2842672f-6230-434f-8232-e88e71560092 Type: VM >2012-08-07 14:49:26,809 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [39d5675b] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-14). >2012-08-07 14:49:26,821 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [39d5675b] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-14, status is not up. Stopping instead. >2012-08-07 14:49:26,814 ERROR [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-29) [47b39cf2] Command org.ovirt.engine.core.bll.StopVmCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to DestroyVDS, error = Virtual machine does not exist >2012-08-07 14:49:26,831 DEBUG [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-29) [47b39cf2] Command org.ovirt.engine.core.bll.StopVmCommand throw Vdc Bll exception: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to DestroyVDS, error = Virtual machine does not exist > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.StopVmCommandBase.Destroy(StopVmCommandBase.java:66) [engine-bll.jar:] > at org.ovirt.engine.core.bll.StopVmCommand.Perform(StopVmCommand.java:14) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VmOperationCommandBase.ExecuteVmCommand(VmOperationCommandBase.java:34) [engine-bll.jar:] > at org.ovirt.engine.core.bll.StopVmCommandBase.ExecuteVmCommand(StopVmCommandBase.java:81) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VmCommand.executeCommand(VmCommand.java:82) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteWithoutTransaction(CommandBase.java:810) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:901) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1256) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:144) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:109) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.Execute(CommandBase.java:916) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteAction(CommandBase.java:275) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:335) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:288) [engine-bll.jar:] > at sun.reflect.GeneratedMethodAccessor140.invoke(Unknown Source) [:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInCallerTx(CMTTxInterceptor.java:202) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:365) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [engine-bll.jar:] > at org.ovirt.engine.core.bll.ShutdownVmCommand.Perform(ShutdownVmCommand.java:80) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VmOperationCommandBase.ExecuteVmCommand(VmOperationCommandBase.java:34) [engine-bll.jar:] > at org.ovirt.engine.core.bll.StopVmCommandBase.ExecuteVmCommand(StopVmCommandBase.java:81) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VmCommand.executeCommand(VmCommand.java:82) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteWithoutTransaction(CommandBase.java:810) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:901) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1256) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:204) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:142) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:109) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.Execute(CommandBase.java:916) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteAction(CommandBase.java:275) [engine-bll.jar:] > at org.ovirt.engine.core.bll.MultipleActionsRunner.executeValidatedCommands(MultipleActionsRunner.java:182) [engine-bll.jar:] > at org.ovirt.engine.core.bll.MultipleActionsRunner.RunCommands(MultipleActionsRunner.java:162) [engine-bll.jar:] > at org.ovirt.engine.core.bll.MultipleActionsRunner$1.run(MultipleActionsRunner.java:84) [engine-bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 14:49:26,838 DEBUG [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-50) [3752695b] Permission check skipped for internal action StopVm. >2012-08-07 14:49:27,311 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-50) [3752695b] Running command: StopVmCommand internal: true. Entities affected : ID: 2842672f-6230-434f-8232-e88e71560092 Type: VM >2012-08-07 14:49:27,318 DEBUG [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-29) [47b39cf2] Command [id=4ec06bc4-ce0c-4e4b-a83c-3f349adda2e5]: No compensation data. >2012-08-07 14:49:27,323 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [3752695b] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, force=false, secondsToWait=0, gracefully=false), log id: 501bd165 >2012-08-07 14:49:27,344 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [3752695b] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, force=false, secondsToWait=0, gracefully=false), log id: 4b911467 >2012-08-07 14:49:27,357 ERROR [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-29) [47b39cf2] Transaction rolled-back for command: org.ovirt.engine.core.bll.StopVmCommand. >2012-08-07 14:49:27,371 ERROR [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) [47b39cf2] Transaction rolled-back for command: org.ovirt.engine.core.bll.ShutdownVmCommand. >2012-08-07 14:49:27,379 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (pool-3-thread-29) [47b39cf2] transaction rolled back >2012-08-07 14:49:27,457 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:27,740 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [3752695b] FINISH, DestroyVDSCommand, log id: 4b911467 >2012-08-07 14:49:27,766 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [3752695b] FINISH, DestroyVmVDSCommand, return: Down, log id: 501bd165 >2012-08-07 14:49:27,942 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [6974a506] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 5524b98a-aa45-49cb-9d8b-bec3884753c9 Type: VM >2012-08-07 14:49:27,945 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [6974a506] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-15). >2012-08-07 14:49:27,951 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) [6974a506] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-15. >2012-08-07 14:49:27,961 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [6974a506] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=5524b98a-aa45-49cb-9d8b-bec3884753c9, force=false, secondsToWait=30, gracefully=true), log id: 656e6921 >2012-08-07 14:49:27,977 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [6974a506] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=5524b98a-aa45-49cb-9d8b-bec3884753c9, force=false, secondsToWait=30, gracefully=true), log id: 4accc189 >2012-08-07 14:49:28,058 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [6974a506] FINISH, DestroyVDSCommand, log id: 4accc189 >2012-08-07 14:49:28,084 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [6974a506] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 656e6921 >2012-08-07 14:49:30,279 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:32,222 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:34,825 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 1/4 (Command type: ShutdownVm) >2012-08-07 14:49:34,830 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 2/4 (Command type: ShutdownVm) >2012-08-07 14:49:34,839 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 >2012-08-07 14:49:34,846 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-29) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 3/4 (Command type: ShutdownVm) >2012-08-07 14:49:34,846 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 4/4 (Command type: ShutdownVm) >2012-08-07 14:49:34,846 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-43) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id d3c805a2-419c-480f-8627-f5c9ef5c4117 >2012-08-07 14:49:34,862 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id c1cb365c-a119-493c-964c-faf65a10c889 >2012-08-07 14:49:34,875 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id c7702cf0-88da-4885-9b9c-9e59772b3774 >2012-08-07 14:49:34,880 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 2/4 (Command type: ShutdownVm) >2012-08-07 14:49:34,888 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 4/4 (Command type: ShutdownVm) >2012-08-07 14:49:34,888 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 1/4 (Command type: ShutdownVm) >2012-08-07 14:49:34,889 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-29) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 3/4 (Command type: ShutdownVm) >2012-08-07 14:49:34,963 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) [3f96fde] Running command: ShutdownVmCommand internal: false. Entities affected : ID: d3c805a2-419c-480f-8627-f5c9ef5c4117 Type: VM >2012-08-07 14:49:34,971 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) [3f96fde] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-3). >2012-08-07 14:49:34,976 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) [3f96fde] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-3. >2012-08-07 14:49:34,981 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-29) [3f96fde] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=d3c805a2-419c-480f-8627-f5c9ef5c4117, force=false, secondsToWait=30, gracefully=true), log id: 16182418 >2012-08-07 14:49:34,994 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-29) [3f96fde] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=d3c805a2-419c-480f-8627-f5c9ef5c4117, force=false, secondsToWait=30, gracefully=true), log id: 61d9fc72 >2012-08-07 14:49:35,055 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-29) [3f96fde] FINISH, DestroyVDSCommand, log id: 61d9fc72 >2012-08-07 14:49:35,081 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-29) [3f96fde] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 16182418 >2012-08-07 14:49:35,201 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) [6d1f59db] Running command: ShutdownVmCommand internal: false. Entities affected : ID: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 Type: VM >2012-08-07 14:49:35,210 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) [6d1f59db] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-4). >2012-08-07 14:49:35,217 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) [6d1f59db] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-4. >2012-08-07 14:49:35,231 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-29) [6d1f59db] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861, force=false, secondsToWait=30, gracefully=true), log id: 18d76539 >2012-08-07 14:49:35,257 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-29) [6d1f59db] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861, force=false, secondsToWait=30, gracefully=true), log id: 451a6b0f >2012-08-07 14:49:35,332 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-29) [6d1f59db] FINISH, DestroyVDSCommand, log id: 451a6b0f >2012-08-07 14:49:35,440 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-29) [6d1f59db] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 18d76539 >2012-08-07 14:49:35,447 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:35,481 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) domain 6eb052fb-6503-4d84-b053-62ed828dbbf2 in problem. vds: purple-vds3 >2012-08-07 14:49:35,706 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) [254470d5] Running command: ShutdownVmCommand internal: false. Entities affected : ID: c1cb365c-a119-493c-964c-faf65a10c889 Type: VM >2012-08-07 14:49:35,714 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) [254470d5] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-5). >2012-08-07 14:49:35,721 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) [254470d5] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-5, status is not up. Stopping instead. >2012-08-07 14:49:35,730 DEBUG [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-29) [54e93692] Permission check skipped for internal action StopVm. >2012-08-07 14:49:35,736 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-29) [54e93692] Running command: StopVmCommand internal: true. Entities affected : ID: c1cb365c-a119-493c-964c-faf65a10c889 Type: VM >2012-08-07 14:49:35,744 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-29) [54e93692] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=c1cb365c-a119-493c-964c-faf65a10c889, force=false, secondsToWait=0, gracefully=false), log id: 4818933b >2012-08-07 14:49:35,994 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-29) [54e93692] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=c1cb365c-a119-493c-964c-faf65a10c889, force=false, secondsToWait=0, gracefully=false), log id: 607ea007 >2012-08-07 14:49:36,347 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-29) [54e93692] FINISH, DestroyVDSCommand, log id: 607ea007 >2012-08-07 14:49:36,402 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-29) [54e93692] FINISH, DestroyVmVDSCommand, return: Down, log id: 4818933b >2012-08-07 14:49:36,529 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) [304bc310] Running command: ShutdownVmCommand internal: false. Entities affected : ID: c7702cf0-88da-4885-9b9c-9e59772b3774 Type: VM >2012-08-07 14:49:36,531 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) [304bc310] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-6). >2012-08-07 14:49:36,541 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) [304bc310] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-6, status is not up. Stopping instead. >2012-08-07 14:49:36,566 DEBUG [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-29) [727a86cf] Permission check skipped for internal action StopVm. >2012-08-07 14:49:36,578 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-29) [727a86cf] Running command: StopVmCommand internal: true. Entities affected : ID: c7702cf0-88da-4885-9b9c-9e59772b3774 Type: VM >2012-08-07 14:49:36,589 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-29) [727a86cf] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=c7702cf0-88da-4885-9b9c-9e59772b3774, force=false, secondsToWait=0, gracefully=false), log id: 46cffc74 >2012-08-07 14:49:36,753 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-29) [727a86cf] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=c7702cf0-88da-4885-9b9c-9e59772b3774, force=false, secondsToWait=0, gracefully=false), log id: 65626f60 >2012-08-07 14:49:36,874 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 1/4 (Command type: ShutdownVm) >2012-08-07 14:49:36,879 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-43) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 >2012-08-07 14:49:36,881 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 4/4 (Command type: ShutdownVm) >2012-08-07 14:49:36,881 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 3/4 (Command type: ShutdownVm) >2012-08-07 14:49:36,880 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 2/4 (Command type: ShutdownVm) >2012-08-07 14:49:36,898 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-44) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id c7702cf0-88da-4885-9b9c-9e59772b3774 >2012-08-07 14:49:36,908 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id d3c805a2-419c-480f-8627-f5c9ef5c4117 >2012-08-07 14:49:36,904 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id c1cb365c-a119-493c-964c-faf65a10c889 >2012-08-07 14:49:36,928 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 3/4 (Command type: ShutdownVm) >2012-08-07 14:49:36,931 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 1/4 (Command type: ShutdownVm) >2012-08-07 14:49:36,931 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 4/4 (Command type: ShutdownVm) >2012-08-07 14:49:36,929 WARN [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-50) CanDoAction of action ShutdownVm failed. Reasons:ACTION_TYPE_FAILED_VM_IS_NOT_RUNNING,VAR__ACTION__SHUTDOWN,VAR__TYPE__VM >2012-08-07 14:49:36,944 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 2/4 (Command type: ShutdownVm) >2012-08-07 14:49:37,110 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-29) [727a86cf] FINISH, DestroyVDSCommand, log id: 65626f60 >2012-08-07 14:49:37,112 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [5876d2b3] Running command: ShutdownVmCommand internal: false. Entities affected : ID: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 Type: VM >2012-08-07 14:49:37,115 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [5876d2b3] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-4). >2012-08-07 14:49:37,131 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [5876d2b3] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-4, status is not up. Stopping instead. >2012-08-07 14:49:37,146 DEBUG [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-45) [17617e4b] Permission check skipped for internal action StopVm. >2012-08-07 14:49:37,155 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-45) [17617e4b] Running command: StopVmCommand internal: true. Entities affected : ID: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 Type: VM >2012-08-07 14:49:37,163 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-45) [17617e4b] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861, force=false, secondsToWait=0, gracefully=false), log id: 26df13d3 >2012-08-07 14:49:37,176 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-29) [727a86cf] FINISH, DestroyVmVDSCommand, return: Down, log id: 46cffc74 >2012-08-07 14:49:37,201 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-45) [17617e4b] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861, force=false, secondsToWait=0, gracefully=false), log id: 4563bd33 >2012-08-07 14:49:37,229 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:37,597 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-45) [17617e4b] FINISH, DestroyVDSCommand, log id: 4563bd33 >2012-08-07 14:49:37,649 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-45) [17617e4b] FINISH, DestroyVmVDSCommand, return: Down, log id: 26df13d3 >2012-08-07 14:49:37,800 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [10ddd23e] Running command: ShutdownVmCommand internal: false. Entities affected : ID: c7702cf0-88da-4885-9b9c-9e59772b3774 Type: VM >2012-08-07 14:49:37,803 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [10ddd23e] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-6). >2012-08-07 14:49:37,809 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [10ddd23e] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-6, status is not up. Stopping instead. >2012-08-07 14:49:37,818 DEBUG [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-45) [2edeeffa] Permission check skipped for internal action StopVm. >2012-08-07 14:49:37,824 WARN [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-45) [2edeeffa] CanDoAction of action StopVm failed. Reasons:ACTION_TYPE_FAILED_VM_IS_NOT_RUNNING,VAR__ACTION__STOP,VAR__TYPE__VM >2012-08-07 14:49:37,937 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [5315ed18] Running command: ShutdownVmCommand internal: false. Entities affected : ID: d3c805a2-419c-480f-8627-f5c9ef5c4117 Type: VM >2012-08-07 14:49:37,949 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [5315ed18] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-3). >2012-08-07 14:49:37,956 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) [5315ed18] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-3, status is not up. Stopping instead. >2012-08-07 14:49:37,970 DEBUG [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-45) [5b072dd1] Permission check skipped for internal action StopVm. >2012-08-07 14:49:37,977 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-45) [5b072dd1] Running command: StopVmCommand internal: true. Entities affected : ID: d3c805a2-419c-480f-8627-f5c9ef5c4117 Type: VM >2012-08-07 14:49:37,988 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-45) [5b072dd1] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=d3c805a2-419c-480f-8627-f5c9ef5c4117, force=false, secondsToWait=0, gracefully=false), log id: 43b6e2a5 >2012-08-07 14:49:38,008 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-45) [5b072dd1] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=d3c805a2-419c-480f-8627-f5c9ef5c4117, force=false, secondsToWait=0, gracefully=false), log id: 5d8b8aef >2012-08-07 14:49:38,398 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-45) [5b072dd1] FINISH, DestroyVDSCommand, log id: 5d8b8aef >2012-08-07 14:49:38,433 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-45) [5b072dd1] FINISH, DestroyVmVDSCommand, return: Down, log id: 43b6e2a5 >2012-08-07 14:49:40,282 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:40,952 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-50) VM pool1-8 96405d4a-a3bd-4900-ab90-9c8736cb02a5 moved from PoweringUp --> Up >2012-08-07 14:49:40,954 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-50) VM pool1-9 8738bb81-c73e-4a41-a24a-c4c49491c536 moved from PoweringUp --> Up >2012-08-07 14:49:41,255 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-50) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@4a7f6f9a), log id: 3bda4dd3 >2012-08-07 14:49:41,280 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-50) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 3bda4dd3 >2012-08-07 14:49:41,286 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-50) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 3. Vm: pool1-8 >2012-08-07 14:49:41,292 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-50) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 1,536. Vm: pool1-8 >2012-08-07 14:49:41,351 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-50) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@b2190fbb), log id: 2adce191 >2012-08-07 14:49:41,372 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-50) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 2adce191 >2012-08-07 14:49:41,373 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-50) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 2. Vm: pool1-9 >2012-08-07 14:49:41,375 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-50) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 1,024. Vm: pool1-9 >2012-08-07 14:49:42,350 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:44,150 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 1/2 (Command type: ShutdownVm) >2012-08-07 14:49:44,151 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 2/2 (Command type: ShutdownVm) >2012-08-07 14:49:44,161 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 8738bb81-c73e-4a41-a24a-c4c49491c536 >2012-08-07 14:49:44,166 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 96405d4a-a3bd-4900-ab90-9c8736cb02a5 >2012-08-07 14:49:44,179 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 1/2 (Command type: ShutdownVm) >2012-08-07 14:49:44,204 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 2/2 (Command type: ShutdownVm) >2012-08-07 14:49:44,263 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-58) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 14:49:44,272 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-58) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 14:49:44,273 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-58) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 14:49:44,274 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-58) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 14:49:44,280 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) [2734f69b] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 Type: VM >2012-08-07 14:49:44,284 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) [2734f69b] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-8). >2012-08-07 14:49:44,284 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) [2734f69b] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-8. >2012-08-07 14:49:44,287 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-47) [2734f69b] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5, force=false, secondsToWait=30, gracefully=true), log id: 49bc8b6b >2012-08-07 14:49:44,309 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-47) [2734f69b] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5, force=false, secondsToWait=30, gracefully=true), log id: 725b60d9 >2012-08-07 14:49:44,390 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-47) [2734f69b] FINISH, DestroyVDSCommand, log id: 725b60d9 >2012-08-07 14:49:44,411 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-47) [2734f69b] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 49bc8b6b >2012-08-07 14:49:44,518 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) [62a4e39] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 8738bb81-c73e-4a41-a24a-c4c49491c536 Type: VM >2012-08-07 14:49:44,526 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) [62a4e39] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-9). >2012-08-07 14:49:44,531 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) [62a4e39] VmHandler.cs:ShutdownVmCommand:Perform: sending shutdown command for Desktop pool1-9. >2012-08-07 14:49:44,538 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-47) [62a4e39] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=8738bb81-c73e-4a41-a24a-c4c49491c536, force=false, secondsToWait=30, gracefully=true), log id: 3cb6e9b1 >2012-08-07 14:49:44,551 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-47) [62a4e39] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=8738bb81-c73e-4a41-a24a-c4c49491c536, force=false, secondsToWait=30, gracefully=true), log id: 53cee7e5 >2012-08-07 14:49:44,612 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-47) [62a4e39] FINISH, DestroyVDSCommand, log id: 53cee7e5 >2012-08-07 14:49:44,632 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-47) [62a4e39] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 3cb6e9b1 >2012-08-07 14:49:45,283 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:47,210 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:48,129 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 1/2 (Command type: ShutdownVm) >2012-08-07 14:49:48,131 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/7/12 2:49 PM. Start running CanDoAction for command number 2/2 (Command type: ShutdownVm) >2012-08-07 14:49:48,144 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-45) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 8738bb81-c73e-4a41-a24a-c4c49491c536 >2012-08-07 14:49:48,160 DEBUG [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-47) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running ShutdownVm, on VM with id 96405d4a-a3bd-4900-ab90-9c8736cb02a5 >2012-08-07 14:49:48,167 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 2/2 (Command type: ShutdownVm) >2012-08-07 14:49:48,171 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/7/12 2:49 PM. Finish handling CanDoAction for command number 1/2 (Command type: ShutdownVm) >2012-08-07 14:49:48,406 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) [7f516eec] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 Type: VM >2012-08-07 14:49:48,415 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) [7f516eec] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-8). >2012-08-07 14:49:48,420 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) [7f516eec] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-8, status is not up. Stopping instead. >2012-08-07 14:49:48,429 DEBUG [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-29) [628e8710] Permission check skipped for internal action StopVm. >2012-08-07 14:49:48,434 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-29) [628e8710] Running command: StopVmCommand internal: true. Entities affected : ID: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 Type: VM >2012-08-07 14:49:48,441 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-29) [628e8710] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5, force=false, secondsToWait=0, gracefully=false), log id: 6e26ae6f >2012-08-07 14:49:48,453 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-29) [628e8710] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5, force=false, secondsToWait=0, gracefully=false), log id: 7b6d4ed1 >2012-08-07 14:49:48,813 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-29) [628e8710] FINISH, DestroyVDSCommand, log id: 7b6d4ed1 >2012-08-07 14:49:48,836 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-29) [628e8710] FINISH, DestroyVmVDSCommand, return: Down, log id: 6e26ae6f >2012-08-07 14:49:48,979 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) [3b498941] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 8738bb81-c73e-4a41-a24a-c4c49491c536 Type: VM >2012-08-07 14:49:48,987 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) [3b498941] VmHandler.cs:ShutdownVmCommand:Perform: entered (Desktop pool1-9). >2012-08-07 14:49:48,992 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-3-thread-29) [3b498941] VmHandler.cs:ShutdownVmCommand:Perform: Cannot shutdown Desktop pool1-9, status is not up. Stopping instead. >2012-08-07 14:49:49,001 DEBUG [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-29) [2670ff3d] Permission check skipped for internal action StopVm. >2012-08-07 14:49:49,006 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-29) [2670ff3d] Running command: StopVmCommand internal: true. Entities affected : ID: 8738bb81-c73e-4a41-a24a-c4c49491c536 Type: VM >2012-08-07 14:49:49,014 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-29) [2670ff3d] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=8738bb81-c73e-4a41-a24a-c4c49491c536, force=false, secondsToWait=0, gracefully=false), log id: 12d86666 >2012-08-07 14:49:49,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-29) [2670ff3d] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=8738bb81-c73e-4a41-a24a-c4c49491c536, force=false, secondsToWait=0, gracefully=false), log id: 21a5b9c6 >2012-08-07 14:49:49,391 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-29) [2670ff3d] FINISH, DestroyVDSCommand, log id: 21a5b9c6 >2012-08-07 14:49:49,412 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-29) [2670ff3d] FINISH, DestroyVmVDSCommand, return: Down, log id: 12d86666 >2012-08-07 14:49:50,293 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:52,214 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:55,283 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:49:57,225 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Checking autorecoverable hosts >2012-08-07 14:50:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Autorecovering 0 hosts >2012-08-07 14:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Checking autorecoverable hosts done >2012-08-07 14:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Checking autorecoverable storage domains >2012-08-07 14:50:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Autorecovering 0 storage domains >2012-08-07 14:50:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Checking autorecoverable storage domains done >2012-08-07 14:50:00,265 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:02,252 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:05,274 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:07,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:10,274 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:12,212 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:15,346 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:17,225 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:20,649 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:22,213 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:25,277 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:27,166 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:30,281 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:32,226 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:35,263 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:37,313 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:40,281 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:42,214 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:44,286 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-56) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 14:50:44,288 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-56) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 14:50:44,295 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-56) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 14:50:44,301 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-56) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 14:50:45,382 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:47,236 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:50,292 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:52,218 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:55,652 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:50:57,212 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:00,493 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:02,214 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:04,063 DEBUG [org.ovirt.engine.core.bll.StopVmCommand] (ajp--127.0.0.1-8009-6) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running StopVm, on VM with id 5524b98a-aa45-49cb-9d8b-bec3884753c9 >2012-08-07 14:51:04,248 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-45) [32dd1f11] Running command: StopVmCommand internal: false. Entities affected : ID: 5524b98a-aa45-49cb-9d8b-bec3884753c9 Type: VM >2012-08-07 14:51:04,251 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-45) [32dd1f11] START, DestroyVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=5524b98a-aa45-49cb-9d8b-bec3884753c9, force=false, secondsToWait=0, gracefully=false), log id: 1d5f2937 >2012-08-07 14:51:04,264 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-45) [32dd1f11] START, DestroyVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=5524b98a-aa45-49cb-9d8b-bec3884753c9, force=false, secondsToWait=0, gracefully=false), log id: 65f45cc5 >2012-08-07 14:51:04,634 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-45) [32dd1f11] FINISH, DestroyVDSCommand, log id: 65f45cc5 >2012-08-07 14:51:04,657 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-45) [32dd1f11] FINISH, DestroyVmVDSCommand, return: Down, log id: 1d5f2937 >2012-08-07 14:51:05,267 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:07,214 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:10,364 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:12,213 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:14,287 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-49) [25824a46] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 14:51:14,288 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-49) [25824a46] FINISH, ConnectStorageServerVDSCommand, log id: 59dac7d >2012-08-07 14:51:14,294 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-49) [25824a46] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 14:51:14,369 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-30) [25824a46] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:51 PM >2012-08-07 14:51:14,370 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (pool-3-thread-30) [25824a46] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 556e1ef7 >2012-08-07 14:51:14,656 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-30) [25824a46] Failed in ActivateStorageDomainVDS method >2012-08-07 14:51:14,656 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-30) [25824a46] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:51:14,658 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-3-thread-30) [25824a46] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:51:14,669 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (pool-3-thread-30) [25824a46] FINISH, ActivateStorageDomainVDSCommand, log id: 556e1ef7 >2012-08-07 14:51:14,675 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-30) [25824a46] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:51:14,688 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-30) [25824a46] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand.executeCommand(ActivateStorageDomainCommand.java:67) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteWithoutTransaction(CommandBase.java:810) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:901) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1256) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:168) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:107) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.Execute(CommandBase.java:916) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteAction(CommandBase.java:275) [engine-bll.jar:] > at org.ovirt.engine.core.bll.MultipleActionsRunner.executeValidatedCommands(MultipleActionsRunner.java:182) [engine-bll.jar:] > at org.ovirt.engine.core.bll.MultipleActionsRunner.RunCommands(MultipleActionsRunner.java:162) [engine-bll.jar:] > at org.ovirt.engine.core.bll.MultipleActionsRunner$1.run(MultipleActionsRunner.java:84) [engine-bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 14:51:14,767 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-30) [25824a46] Command [id=27cf4c28-16bd-4a8f-9783-5b4bd25b10d8]: Going over compensation data. >2012-08-07 14:51:14,776 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-30) [25824a46] Command [id=27cf4c28-16bd-4a8f-9783-5b4bd25b10d8]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 14:51:15,197 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:17,336 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:18,589 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-13) Domain 6eb052fb-6503-4d84-b053-62ed828dbbf2 recovered from problem. vds: purple-vds3 >2012-08-07 14:51:18,605 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-13) Domain 6eb052fb-6503-4d84-b053-62ed828dbbf2 has recovered from problem. No active host in the DC is reporting it as problematic, so clearing the domain recovery timer. >2012-08-07 14:51:20,266 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:22,224 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:25,269 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:26,575 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) Start time: 8/7/12 2:51 PM. Start running CanDoAction for command number 1/10 (Command type: RunVm) >2012-08-07 14:51:26,576 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-30) Start time: 8/7/12 2:51 PM. Start running CanDoAction for command number 2/10 (Command type: RunVm) >2012-08-07 14:51:26,579 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/7/12 2:51 PM. Start running CanDoAction for command number 3/10 (Command type: RunVm) >2012-08-07 14:51:26,580 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/7/12 2:51 PM. Start running CanDoAction for command number 4/10 (Command type: RunVm) >2012-08-07 14:51:26,581 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-41) Start time: 8/7/12 2:51 PM. Start running CanDoAction for command number 5/10 (Command type: RunVm) >2012-08-07 14:51:26,584 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) Start time: 8/7/12 2:51 PM. Start running CanDoAction for command number 6/10 (Command type: RunVm) >2012-08-07 14:51:26,586 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-29) Start time: 8/7/12 2:51 PM. Start running CanDoAction for command number 7/10 (Command type: RunVm) >2012-08-07 14:51:26,589 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) Start time: 8/7/12 2:51 PM. Start running CanDoAction for command number 8/10 (Command type: RunVm) >2012-08-07 14:51:26,592 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) Start time: 8/7/12 2:51 PM. Start running CanDoAction for command number 9/10 (Command type: RunVm) >2012-08-07 14:51:26,595 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) Start time: 8/7/12 2:51 PM. Start running CanDoAction for command number 10/10 (Command type: RunVm) >2012-08-07 14:51:26,611 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id d3c805a2-419c-480f-8627-f5c9ef5c4117 >2012-08-07 14:51:26,643 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-29) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id c1cb365c-a119-493c-964c-faf65a10c889 >2012-08-07 14:51:26,640 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 3ce0f220-6cb8-42d8-b922-7003c60ccdad >2012-08-07 14:51:26,636 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-47) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id c7702cf0-88da-4885-9b9c-9e59772b3774 >2012-08-07 14:51:26,628 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 5524b98a-aa45-49cb-9d8b-bec3884753c9 >2012-08-07 14:51:26,628 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-43) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 96405d4a-a3bd-4900-ab90-9c8736cb02a5 >2012-08-07 14:51:26,624 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-44) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 >2012-08-07 14:51:26,618 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-30) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 2842672f-6230-434f-8232-e88e71560092 >2012-08-07 14:51:26,616 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 6df57989-99a7-4ec9-8f7c-15f222064e61 >2012-08-07 14:51:26,653 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) Before acquiring lock EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] >2012-08-07 14:51:26,667 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 6c1fcddf-86d6-4533-905b-abb11b775f5b >2012-08-07 14:51:26,662 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-47) Before acquiring lock EngineLock [exclusiveLocks= key: c7702cf0-88da-4885-9b9c-9e59772b3774 value: VM >, sharedLocks= ] >2012-08-07 14:51:26,670 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-47) Successed acquiring lock EngineLock [exclusiveLocks= key: c7702cf0-88da-4885-9b9c-9e59772b3774 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:51:26,671 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-47) Lock Acquired to object EngineLock [exclusiveLocks= key: c7702cf0-88da-4885-9b9c-9e59772b3774 value: VM >, sharedLocks= ] >2012-08-07 14:51:26,661 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-50) Before acquiring lock EngineLock [exclusiveLocks= key: 3ce0f220-6cb8-42d8-b922-7003c60ccdad value: VM >, sharedLocks= ] >2012-08-07 14:51:26,661 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) Before acquiring lock EngineLock [exclusiveLocks= key: d3c805a2-419c-480f-8627-f5c9ef5c4117 value: VM >, sharedLocks= ] >2012-08-07 14:51:26,659 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-29) Before acquiring lock EngineLock [exclusiveLocks= key: c1cb365c-a119-493c-964c-faf65a10c889 value: VM >, sharedLocks= ] >2012-08-07 14:51:26,658 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-43) Before acquiring lock EngineLock [exclusiveLocks= key: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 value: VM >, sharedLocks= ] >2012-08-07 14:51:26,657 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-44) Before acquiring lock EngineLock [exclusiveLocks= key: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 value: VM >, sharedLocks= ] >2012-08-07 14:51:26,657 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-30) Before acquiring lock EngineLock [exclusiveLocks= key: 2842672f-6230-434f-8232-e88e71560092 value: VM >, sharedLocks= ] >2012-08-07 14:51:26,656 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) Before acquiring lock EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-07 14:51:26,673 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-49) Before acquiring lock EngineLock [exclusiveLocks= key: 6c1fcddf-86d6-4533-905b-abb11b775f5b value: VM >, sharedLocks= ] >2012-08-07 14:51:26,672 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) Successed acquiring lock EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:51:26,686 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-50) Successed acquiring lock EngineLock [exclusiveLocks= key: 3ce0f220-6cb8-42d8-b922-7003c60ccdad value: VM >, sharedLocks= ] succeeded >2012-08-07 14:51:26,687 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) Lock Acquired to object EngineLock [exclusiveLocks= key: 3ce0f220-6cb8-42d8-b922-7003c60ccdad value: VM >, sharedLocks= ] >2012-08-07 14:51:26,688 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-29) Successed acquiring lock EngineLock [exclusiveLocks= key: c1cb365c-a119-493c-964c-faf65a10c889 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:51:26,689 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-29) Lock Acquired to object EngineLock [exclusiveLocks= key: c1cb365c-a119-493c-964c-faf65a10c889 value: VM >, sharedLocks= ] >2012-08-07 14:51:26,691 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-43) Successed acquiring lock EngineLock [exclusiveLocks= key: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:51:26,692 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-43) Lock Acquired to object EngineLock [exclusiveLocks= key: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 value: VM >, sharedLocks= ] >2012-08-07 14:51:26,694 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-44) Successed acquiring lock EngineLock [exclusiveLocks= key: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:51:26,695 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-44) Lock Acquired to object EngineLock [exclusiveLocks= key: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 value: VM >, sharedLocks= ] >2012-08-07 14:51:26,697 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-30) Successed acquiring lock EngineLock [exclusiveLocks= key: 2842672f-6230-434f-8232-e88e71560092 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:51:26,698 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-30) Lock Acquired to object EngineLock [exclusiveLocks= key: 2842672f-6230-434f-8232-e88e71560092 value: VM >, sharedLocks= ] >2012-08-07 14:51:26,700 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) Successed acquiring lock EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:51:26,701 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) Lock Acquired to object EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-07 14:51:26,703 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-49) Successed acquiring lock EngineLock [exclusiveLocks= key: 6c1fcddf-86d6-4533-905b-abb11b775f5b value: VM >, sharedLocks= ] succeeded >2012-08-07 14:51:26,704 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-49) Lock Acquired to object EngineLock [exclusiveLocks= key: 6c1fcddf-86d6-4533-905b-abb11b775f5b value: VM >, sharedLocks= ] >2012-08-07 14:51:26,706 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-41) Successed acquiring lock EngineLock [exclusiveLocks= key: d3c805a2-419c-480f-8627-f5c9ef5c4117 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:51:26,707 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-41) Lock Acquired to object EngineLock [exclusiveLocks= key: d3c805a2-419c-480f-8627-f5c9ef5c4117 value: VM >, sharedLocks= ] >2012-08-07 14:51:26,721 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) Lock Acquired to object EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] >2012-08-07 14:51:26,768 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-30) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 76b63bc0 >2012-08-07 14:51:26,795 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 463623fc >2012-08-07 14:51:26,790 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 792faadd >2012-08-07 14:51:26,784 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-29) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 53416816 >2012-08-07 14:51:26,777 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 743fe3f0 >2012-08-07 14:51:26,776 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6dbe6684 >2012-08-07 14:51:26,774 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-41) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 79e5498b >2012-08-07 14:51:26,771 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-47) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: d35368e >2012-08-07 14:51:26,810 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-47) FINISH, IsValidVDSCommand, return: true, log id: d35368e >2012-08-07 14:51:26,823 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-29) FINISH, IsValidVDSCommand, return: true, log id: 53416816 >2012-08-07 14:51:26,816 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) FINISH, IsValidVDSCommand, return: true, log id: 792faadd >2012-08-07 14:51:26,815 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-43) FINISH, IsValidVDSCommand, return: true, log id: 6dbe6684 >2012-08-07 14:51:26,816 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) FINISH, IsValidVDSCommand, return: true, log id: 463623fc >2012-08-07 14:51:26,815 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-41) FINISH, IsValidVDSCommand, return: true, log id: 79e5498b >2012-08-07 14:51:26,815 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) FINISH, IsValidVDSCommand, return: true, log id: 743fe3f0 >2012-08-07 14:51:26,848 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-30) FINISH, IsValidVDSCommand, return: true, log id: 76b63bc0 >2012-08-07 14:51:27,032 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) START, IsVmDuringInitiatingVDSCommand(vmId = 6c1fcddf-86d6-4533-905b-abb11b775f5b), log id: 39720815 >2012-08-07 14:51:27,033 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-49) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 39720815 >2012-08-07 14:51:27,034 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-30) START, IsVmDuringInitiatingVDSCommand(vmId = 2842672f-6230-434f-8232-e88e71560092), log id: 34ac3e1 >2012-08-07 14:51:27,035 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-30) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 34ac3e1 >2012-08-07 14:51:27,036 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) START, IsVmDuringInitiatingVDSCommand(vmId = 3ce0f220-6cb8-42d8-b922-7003c60ccdad), log id: 6e4f01f7 >2012-08-07 14:51:27,037 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-50) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 6e4f01f7 >2012-08-07 14:51:27,038 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-47) START, IsVmDuringInitiatingVDSCommand(vmId = c7702cf0-88da-4885-9b9c-9e59772b3774), log id: 61cf4ea8 >2012-08-07 14:51:27,039 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-47) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 61cf4ea8 >2012-08-07 14:51:27,041 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-41) START, IsVmDuringInitiatingVDSCommand(vmId = d3c805a2-419c-480f-8627-f5c9ef5c4117), log id: 1d570fa5 >2012-08-07 14:51:27,042 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-41) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 1d570fa5 >2012-08-07 14:51:27,068 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-47) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:51:27,064 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: a934750 >2012-08-07 14:51:27,062 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-50) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:51:27,081 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-50) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:27,081 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-50) 898 <= ??? 9,881 >2012-08-07 14:51:27,062 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-30) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:51:27,083 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-30) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:27,061 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-49) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:51:27,044 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-43) START, IsVmDuringInitiatingVDSCommand(vmId = 96405d4a-a3bd-4900-ab90-9c8736cb02a5), log id: 7fa1588e >2012-08-07 14:51:27,095 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-43) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 7fa1588e >2012-08-07 14:51:27,043 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) START, IsVmDuringInitiatingVDSCommand(vmId = 5524b98a-aa45-49cb-9d8b-bec3884753c9), log id: 6422400e >2012-08-07 14:51:27,097 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 6422400e >2012-08-07 14:51:27,043 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-29) START, IsVmDuringInitiatingVDSCommand(vmId = c1cb365c-a119-493c-964c-faf65a10c889), log id: 404b195a >2012-08-07 14:51:27,100 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-29) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 404b195a >2012-08-07 14:51:27,095 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-49) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:27,105 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-49) 898 <= ??? 9,881 >2012-08-07 14:51:27,086 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-47) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:27,109 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-43) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:51:27,120 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-43) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:27,121 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-43) 898 <= ??? 9,881 >2012-08-07 14:51:27,086 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) FINISH, IsValidVDSCommand, return: true, log id: a934750 >2012-08-07 14:51:27,077 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-44) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 20c9d93c >2012-08-07 14:51:27,076 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:51:27,129 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:27,129 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-41) 898 <= ??? 9,881 >2012-08-07 14:51:27,121 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) End time: 8/7/12 2:51 PM. Finish handling CanDoAction for command number 9/10 (Command type: RunVm) >2012-08-07 14:51:27,112 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) End time: 8/7/12 2:51 PM. Finish handling CanDoAction for command number 1/10 (Command type: RunVm) >2012-08-07 14:51:27,111 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-30) 898 <= ??? 9,881 >2012-08-07 14:51:27,110 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-47) 898 <= ??? 9,881 >2012-08-07 14:51:27,110 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-29) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:51:27,134 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-29) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:27,135 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-29) 898 <= ??? 9,881 >2012-08-07 14:51:27,142 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-44) FINISH, IsValidVDSCommand, return: true, log id: 20c9d93c >2012-08-07 14:51:27,139 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-30) End time: 8/7/12 2:51 PM. Finish handling CanDoAction for command number 2/10 (Command type: RunVm) >2012-08-07 14:51:27,139 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) End time: 8/7/12 2:51 PM. Finish handling CanDoAction for command number 8/10 (Command type: RunVm) >2012-08-07 14:51:27,149 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-41) End time: 8/7/12 2:51 PM. Finish handling CanDoAction for command number 5/10 (Command type: RunVm) >2012-08-07 14:51:27,157 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-43) End time: 8/7/12 2:51 PM. Finish handling CanDoAction for command number 10/10 (Command type: RunVm) >2012-08-07 14:51:27,154 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-29) End time: 8/7/12 2:51 PM. Finish handling CanDoAction for command number 7/10 (Command type: RunVm) >2012-08-07 14:51:27,183 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:51:27,188 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:27,197 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) 898 <= ??? 9,881 >2012-08-07 14:51:27,215 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:27,220 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/7/12 2:51 PM. Finish handling CanDoAction for command number 3/10 (Command type: RunVm) >2012-08-07 14:51:27,255 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-44) START, IsVmDuringInitiatingVDSCommand(vmId = a7d2a056-b67b-4bc5-b8ea-7afef2d2b861), log id: 29996f48 >2012-08-07 14:51:27,255 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-44) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 29996f48 >2012-08-07 14:51:27,267 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-44) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:51:27,279 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-44) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:27,290 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-44) 898 <= ??? 9,881 >2012-08-07 14:51:27,301 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) End time: 8/7/12 2:51 PM. Finish handling CanDoAction for command number 6/10 (Command type: RunVm) >2012-08-07 14:51:27,379 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) START, IsVmDuringInitiatingVDSCommand(vmId = 6df57989-99a7-4ec9-8f7c-15f222064e61), log id: 30ad9f3a >2012-08-07 14:51:27,380 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 30ad9f3a >2012-08-07 14:51:27,390 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:51:27,398 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:27,409 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) 898 <= ??? 9,881 >2012-08-07 14:51:27,416 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 8/7/12 2:51 PM. Start running CanDoAction for command number 11/12 (Command type: RunVm) >2012-08-07 14:51:27,417 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) Start time: 8/7/12 2:51 PM. Start running CanDoAction for command number 12/12 (Command type: RunVm) >2012-08-07 14:51:27,426 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 8738bb81-c73e-4a41-a24a-c4c49491c536 >2012-08-07 14:51:27,431 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-44) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id e5a192f1-3f9d-48e1-a817-28f72815c646 >2012-08-07 14:51:27,430 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/7/12 2:51 PM. Finish handling CanDoAction for command number 4/10 (Command type: RunVm) >2012-08-07 14:51:27,441 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-44) Before acquiring lock EngineLock [exclusiveLocks= key: e5a192f1-3f9d-48e1-a817-28f72815c646 value: VM >, sharedLocks= ] >2012-08-07 14:51:27,442 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) Before acquiring lock EngineLock [exclusiveLocks= key: 8738bb81-c73e-4a41-a24a-c4c49491c536 value: VM >, sharedLocks= ] >2012-08-07 14:51:27,453 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-46) Successed acquiring lock EngineLock [exclusiveLocks= key: 8738bb81-c73e-4a41-a24a-c4c49491c536 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:51:27,454 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) Lock Acquired to object EngineLock [exclusiveLocks= key: 8738bb81-c73e-4a41-a24a-c4c49491c536 value: VM >, sharedLocks= ] >2012-08-07 14:51:27,454 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-44) Successed acquiring lock EngineLock [exclusiveLocks= key: e5a192f1-3f9d-48e1-a817-28f72815c646 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:51:27,464 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-44) Lock Acquired to object EngineLock [exclusiveLocks= key: e5a192f1-3f9d-48e1-a817-28f72815c646 value: VM >, sharedLocks= ] >2012-08-07 14:51:27,483 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 7c1c6d0f >2012-08-07 14:51:27,484 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-44) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 7255576d >2012-08-07 14:51:27,497 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-44) FINISH, IsValidVDSCommand, return: true, log id: 7255576d >2012-08-07 14:51:27,500 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) FINISH, IsValidVDSCommand, return: true, log id: 7c1c6d0f >2012-08-07 14:51:27,600 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-44) START, IsVmDuringInitiatingVDSCommand(vmId = e5a192f1-3f9d-48e1-a817-28f72815c646), log id: 27b57917 >2012-08-07 14:51:27,600 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-44) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 27b57917 >2012-08-07 14:51:27,609 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-44) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:51:27,614 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-44) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:27,627 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-44) 898 <= ??? 9,881 >2012-08-07 14:51:27,639 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) End time: 8/7/12 2:51 PM. Finish handling CanDoAction for command number 12/12 (Command type: RunVm) >2012-08-07 14:51:27,785 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) START, IsVmDuringInitiatingVDSCommand(vmId = 8738bb81-c73e-4a41-a24a-c4c49491c536), log id: 346e2b1 >2012-08-07 14:51:27,786 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-46) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 346e2b1 >2012-08-07 14:51:27,812 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:51:27,813 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:27,816 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-46) 898 <= ??? 9,881 >2012-08-07 14:51:27,828 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 8/7/12 2:51 PM. Finish handling CanDoAction for command number 11/12 (Command type: RunVm) >2012-08-07 14:51:27,965 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [6853a9aa] Running command: RunVmCommand internal: false. Entities affected : ID: 6c1fcddf-86d6-4533-905b-abb11b775f5b Type: VM >2012-08-07 14:51:28,019 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [6853a9aa] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 0 MB >2012-08-07 14:51:28,020 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [6853a9aa] Host Mem Conmmitted: 0, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:28,025 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [6853a9aa] 898 <= ??? 9,881 >2012-08-07 14:51:28,050 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [6853a9aa] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, vm=org.ovirt.engine.core.common.businessentities.VM@1df9c361), log id: 7a6d4d7a >2012-08-07 14:51:28,057 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [6853a9aa] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b, vm=org.ovirt.engine.core.common.businessentities.VM@1df9c361), log id: 4855e4d5 >2012-08-07 14:51:28,119 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [6853a9aa] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=6c1fcddf-86d6-4533-905b-abb11b775f5b,devices=[Ljava.util.Map;@20a14f36,acpiEnable=true,vmName=pool1-13,cpuType=Conroe,custom={device_c86af19c-c58e-4d61-b200-1e7968dd5364device_46622c98-58c7-40c5-a9e6-df8ba1848a5ddevice_baaab8cf-cfaa-4f9d-a1d8-242f1b1b0b3adevice_640f127e-1b05-4a12-9412-d2bfedca3ccddevice_7b2ba2ea-2978-416f-b624-e767c0f8b4cd=VmId=6c1fcddf-86d6-4533-905b-abb11b775f5b,DeviceId=7b2ba2ea-2978-416f-b624-e767c0f8b4cd,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_c86af19c-c58e-4d61-b200-1e7968dd5364device_46622c98-58c7-40c5-a9e6-df8ba1848a5ddevice_baaab8cf-cfaa-4f9d-a1d8-242f1b1b0b3a=VmId=6c1fcddf-86d6-4533-905b-abb11b775f5b,DeviceId=baaab8cf-cfaa-4f9d-a1d8-242f1b1b0b3a,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_c86af19c-c58e-4d61-b200-1e7968dd5364device_46622c98-58c7-40c5-a9e6-df8ba1848a5ddevice_baaab8cf-cfaa-4f9d-a1d8-242f1b1b0b3adevice_640f127e-1b05-4a12-9412-d2bfedca3ccd=VmId=6c1fcddf-86d6-4533-905b-abb11b775f5b,DeviceId=640f127e-1b05-4a12-9412-d2bfedca3ccd,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_c86af19c-c58e-4d61-b200-1e7968dd5364device_46622c98-58c7-40c5-a9e6-df8ba1848a5d=VmId=6c1fcddf-86d6-4533-905b-abb11b775f5b,DeviceId=46622c98-58c7-40c5-a9e6-df8ba1848a5d,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_c86af19c-c58e-4d61-b200-1e7968dd5364=VmId=6c1fcddf-86d6-4533-905b-abb11b775f5b,DeviceId=c86af19c-c58e-4d61-b200-1e7968dd5364,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0} >2012-08-07 14:51:28,183 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [6853a9aa] FINISH, CreateVDSCommand, log id: 4855e4d5 >2012-08-07 14:51:28,199 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [6853a9aa] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 1. Vm: pool1-13 >2012-08-07 14:51:28,252 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [6853a9aa] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 7a6d4d7a >2012-08-07 14:51:28,253 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [6853a9aa] Before releasing a lock EngineLock [exclusiveLocks= key: 6c1fcddf-86d6-4533-905b-abb11b775f5b value: VM >, sharedLocks= ] >2012-08-07 14:51:28,257 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [6853a9aa] The exclusive lock for key 6c1fcddf-86d6-4533-905b-abb11b775f5bVM is released and lock is removed from map >2012-08-07 14:51:28,266 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [6853a9aa] Lock freed to object EngineLock [exclusiveLocks= key: 6c1fcddf-86d6-4533-905b-abb11b775f5b value: VM >, sharedLocks= ] >2012-08-07 14:51:28,459 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [65b2809f] Running command: RunVmCommand internal: false. Entities affected : ID: d3c805a2-419c-480f-8627-f5c9ef5c4117 Type: VM >2012-08-07 14:51:28,478 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [65b2809f] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 512 MB >2012-08-07 14:51:28,479 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [65b2809f] Host Mem Conmmitted: 577, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:28,480 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [65b2809f] 1,987 <= ??? 9,881 >2012-08-07 14:51:28,527 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [65b2809f] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=d3c805a2-419c-480f-8627-f5c9ef5c4117, vm=org.ovirt.engine.core.common.businessentities.VM@f4c9aa), log id: 5dace132 >2012-08-07 14:51:28,539 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [65b2809f] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=d3c805a2-419c-480f-8627-f5c9ef5c4117, vm=org.ovirt.engine.core.common.businessentities.VM@f4c9aa), log id: 54941d48 >2012-08-07 14:51:28,628 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [65b2809f] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=d3c805a2-419c-480f-8627-f5c9ef5c4117,devices=[Ljava.util.Map;@5d06c526,acpiEnable=true,vmName=pool1-3,cpuType=Conroe,custom={device_9313a716-f457-4cf6-ac99-1d69ac546ee5=VmId=d3c805a2-419c-480f-8627-f5c9ef5c4117,DeviceId=9313a716-f457-4cf6-ac99-1d69ac546ee5,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_9313a716-f457-4cf6-ac99-1d69ac546ee5device_0ecbab86-631e-4f8e-8f34-a698259429c4=VmId=d3c805a2-419c-480f-8627-f5c9ef5c4117,DeviceId=0ecbab86-631e-4f8e-8f34-a698259429c4,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_9313a716-f457-4cf6-ac99-1d69ac546ee5device_0ecbab86-631e-4f8e-8f34-a698259429c4device_f232af7f-9e18-4531-8c59-45fd2b08b50a=VmId=d3c805a2-419c-480f-8627-f5c9ef5c4117,DeviceId=f232af7f-9e18-4531-8c59-45fd2b08b50a,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_9313a716-f457-4cf6-ac99-1d69ac546ee5device_0ecbab86-631e-4f8e-8f34-a698259429c4device_f232af7f-9e18-4531-8c59-45fd2b08b50adevice_25bc40e4-95fb-4ccb-bdea-af631ad2379cdevice_c667fc67-62f5-44ec-b335-0e2d695e5aca=VmId=d3c805a2-419c-480f-8627-f5c9ef5c4117,DeviceId=c667fc67-62f5-44ec-b335-0e2d695e5aca,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_9313a716-f457-4cf6-ac99-1d69ac546ee5device_0ecbab86-631e-4f8e-8f34-a698259429c4device_f232af7f-9e18-4531-8c59-45fd2b08b50adevice_25bc40e4-95fb-4ccb-bdea-af631ad2379c=VmId=d3c805a2-419c-480f-8627-f5c9ef5c4117,DeviceId=25bc40e4-95fb-4ccb-bdea-af631ad2379c,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0} >2012-08-07 14:51:28,709 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [65b2809f] FINISH, CreateVDSCommand, log id: 54941d48 >2012-08-07 14:51:28,726 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [65b2809f] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 2. Vm: pool1-3 >2012-08-07 14:51:28,786 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [65b2809f] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 5dace132 >2012-08-07 14:51:28,787 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [65b2809f] Before releasing a lock EngineLock [exclusiveLocks= key: d3c805a2-419c-480f-8627-f5c9ef5c4117 value: VM >, sharedLocks= ] >2012-08-07 14:51:28,791 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [65b2809f] The exclusive lock for key d3c805a2-419c-480f-8627-f5c9ef5c4117VM is released and lock is removed from map >2012-08-07 14:51:28,798 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [65b2809f] Lock freed to object EngineLock [exclusiveLocks= key: d3c805a2-419c-480f-8627-f5c9ef5c4117 value: VM >, sharedLocks= ] >2012-08-07 14:51:28,930 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [e9d6f87] Running command: RunVmCommand internal: false. Entities affected : ID: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 Type: VM >2012-08-07 14:51:28,944 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [e9d6f87] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 1,024 MB >2012-08-07 14:51:28,949 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [e9d6f87] Host Mem Conmmitted: 1,154, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:28,956 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [e9d6f87] 3,076 <= ??? 9,881 >2012-08-07 14:51:29,032 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [e9d6f87] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861, vm=org.ovirt.engine.core.common.businessentities.VM@6537ca69), log id: 41ebe1d6 >2012-08-07 14:51:29,037 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [e9d6f87] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861, vm=org.ovirt.engine.core.common.businessentities.VM@6537ca69), log id: 29d116a5 >2012-08-07 14:51:29,189 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [e9d6f87] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861,devices=[Ljava.util.Map;@1cb6d484,acpiEnable=true,vmName=pool1-4,cpuType=Conroe,custom={device_ae69a065-7562-45fa-872f-63c61a9789e4=VmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861,DeviceId=ae69a065-7562-45fa-872f-63c61a9789e4,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_ae69a065-7562-45fa-872f-63c61a9789e4device_de2b905e-4bcc-4d72-8b1f-eae470e1f9abdevice_ab19e80d-bcc4-430a-a424-302984ea6572=VmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861,DeviceId=ab19e80d-bcc4-430a-a424-302984ea6572,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_ae69a065-7562-45fa-872f-63c61a9789e4device_de2b905e-4bcc-4d72-8b1f-eae470e1f9abdevice_ab19e80d-bcc4-430a-a424-302984ea6572device_f26de0f0-90e8-4bca-a679-cc0841d38e93device_0d0bb32a-abda-4210-ab9b-47728f5ec5ad=VmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861,DeviceId=0d0bb32a-abda-4210-ab9b-47728f5ec5ad,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_ae69a065-7562-45fa-872f-63c61a9789e4device_de2b905e-4bcc-4d72-8b1f-eae470e1f9abdevice_ab19e80d-bcc4-430a-a424-302984ea6572device_f26de0f0-90e8-4bca-a679-cc0841d38e93=VmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861,DeviceId=f26de0f0-90e8-4bca-a679-cc0841d38e93,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_ae69a065-7562-45fa-872f-63c61a9789e4device_de2b905e-4bcc-4d72-8b1f-eae470e1f9ab=VmId=a7d2a056-b67b-4bc5-b8ea-7afef2d2b861,DeviceId=de2b905e-4bcc-4d72-8b1f-eae470e1f9ab,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0} >2012-08-07 14:51:29,297 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [e9d6f87] FINISH, CreateVDSCommand, log id: 29d116a5 >2012-08-07 14:51:29,313 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [e9d6f87] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 3. Vm: pool1-4 >2012-08-07 14:51:29,395 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [e9d6f87] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 41ebe1d6 >2012-08-07 14:51:29,396 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [e9d6f87] Before releasing a lock EngineLock [exclusiveLocks= key: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 value: VM >, sharedLocks= ] >2012-08-07 14:51:29,397 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [e9d6f87] The exclusive lock for key a7d2a056-b67b-4bc5-b8ea-7afef2d2b861VM is released and lock is removed from map >2012-08-07 14:51:29,399 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [e9d6f87] Lock freed to object EngineLock [exclusiveLocks= key: a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 value: VM >, sharedLocks= ] >2012-08-07 14:51:29,513 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [483c2691] Running command: RunVmCommand internal: false. Entities affected : ID: 2842672f-6230-434f-8232-e88e71560092 Type: VM >2012-08-07 14:51:29,527 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [483c2691] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 1,536 MB >2012-08-07 14:51:29,532 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [483c2691] Host Mem Conmmitted: 1,731, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:29,538 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [483c2691] 4,165 <= ??? 9,881 >2012-08-07 14:51:29,570 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [483c2691] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, vm=org.ovirt.engine.core.common.businessentities.VM@79173c4f), log id: 3f0d295f >2012-08-07 14:51:29,577 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [483c2691] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=2842672f-6230-434f-8232-e88e71560092, vm=org.ovirt.engine.core.common.businessentities.VM@79173c4f), log id: 15b923ac >2012-08-07 14:51:29,725 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [483c2691] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=2842672f-6230-434f-8232-e88e71560092,devices=[Ljava.util.Map;@3e0d9978,acpiEnable=true,vmName=pool1-14,cpuType=Conroe,custom={device_289c487d-f8cd-4669-aff3-dc550734b3db=VmId=2842672f-6230-434f-8232-e88e71560092,DeviceId=289c487d-f8cd-4669-aff3-dc550734b3db,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_289c487d-f8cd-4669-aff3-dc550734b3dbdevice_57665007-812b-49b6-91c5-ff4b383399b3=VmId=2842672f-6230-434f-8232-e88e71560092,DeviceId=57665007-812b-49b6-91c5-ff4b383399b3,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_289c487d-f8cd-4669-aff3-dc550734b3dbdevice_57665007-812b-49b6-91c5-ff4b383399b3device_0afefa47-c3bd-4313-a443-398b6d46ceebdevice_82eafa6c-e1f8-4171-a48c-be565a770493device_44dad1ca-a5bb-482c-8d73-1da8b69d6f54=VmId=2842672f-6230-434f-8232-e88e71560092,DeviceId=44dad1ca-a5bb-482c-8d73-1da8b69d6f54,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_289c487d-f8cd-4669-aff3-dc550734b3dbdevice_57665007-812b-49b6-91c5-ff4b383399b3device_0afefa47-c3bd-4313-a443-398b6d46ceebdevice_82eafa6c-e1f8-4171-a48c-be565a770493=VmId=2842672f-6230-434f-8232-e88e71560092,DeviceId=82eafa6c-e1f8-4171-a48c-be565a770493,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_289c487d-f8cd-4669-aff3-dc550734b3dbdevice_57665007-812b-49b6-91c5-ff4b383399b3device_0afefa47-c3bd-4313-a443-398b6d46ceeb=VmId=2842672f-6230-434f-8232-e88e71560092,DeviceId=0afefa47-c3bd-4313-a443-398b6d46ceeb,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0} >2012-08-07 14:51:29,788 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [483c2691] FINISH, CreateVDSCommand, log id: 15b923ac >2012-08-07 14:51:29,799 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [483c2691] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 4. Vm: pool1-14 >2012-08-07 14:51:29,839 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [483c2691] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 3f0d295f >2012-08-07 14:51:29,845 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [483c2691] Before releasing a lock EngineLock [exclusiveLocks= key: 2842672f-6230-434f-8232-e88e71560092 value: VM >, sharedLocks= ] >2012-08-07 14:51:29,858 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [483c2691] The exclusive lock for key 2842672f-6230-434f-8232-e88e71560092VM is released and lock is removed from map >2012-08-07 14:51:29,867 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [483c2691] Lock freed to object EngineLock [exclusiveLocks= key: 2842672f-6230-434f-8232-e88e71560092 value: VM >, sharedLocks= ] >2012-08-07 14:51:29,960 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [2157649] Running command: RunVmCommand internal: false. Entities affected : ID: e5a192f1-3f9d-48e1-a817-28f72815c646 Type: VM >2012-08-07 14:51:29,974 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [2157649] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 2,048 MB >2012-08-07 14:51:29,979 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [2157649] Host Mem Conmmitted: 2,308, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:29,985 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [2157649] 5,254 <= ??? 9,881 >2012-08-07 14:51:30,018 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [2157649] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, vm=org.ovirt.engine.core.common.businessentities.VM@3c54d80b), log id: 6a8ac42a >2012-08-07 14:51:30,028 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [2157649] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=e5a192f1-3f9d-48e1-a817-28f72815c646, vm=org.ovirt.engine.core.common.businessentities.VM@3c54d80b), log id: 355556e5 >2012-08-07 14:51:30,121 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [2157649] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=e5a192f1-3f9d-48e1-a817-28f72815c646,devices=[Ljava.util.Map;@6bf8f8e7,acpiEnable=true,vmName=pool1-12,cpuType=Conroe,custom={device_036b0e2d-319b-4b26-a6c1-676f9952948fdevice_206ae8bc-367b-413c-98d2-620f97670689device_65bd0b41-151a-4af9-9fe1-bf1d1bdb59e9device_cbfb21ae-7c77-4357-9d4f-78b200c3999f=VmId=e5a192f1-3f9d-48e1-a817-28f72815c646,DeviceId=cbfb21ae-7c77-4357-9d4f-78b200c3999f,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_036b0e2d-319b-4b26-a6c1-676f9952948fdevice_206ae8bc-367b-413c-98d2-620f97670689device_65bd0b41-151a-4af9-9fe1-bf1d1bdb59e9=VmId=e5a192f1-3f9d-48e1-a817-28f72815c646,DeviceId=65bd0b41-151a-4af9-9fe1-bf1d1bdb59e9,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_036b0e2d-319b-4b26-a6c1-676f9952948fdevice_206ae8bc-367b-413c-98d2-620f97670689=VmId=e5a192f1-3f9d-48e1-a817-28f72815c646,DeviceId=206ae8bc-367b-413c-98d2-620f97670689,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_036b0e2d-319b-4b26-a6c1-676f9952948fdevice_206ae8bc-367b-413c-98d2-620f97670689device_65bd0b41-151a-4af9-9fe1-bf1d1bdb59e9device_cbfb21ae-7c77-4357-9d4f-78b200c3999fdevice_9d2bddae-d38c-404e-81fd-79807b82598f=VmId=e5a192f1-3f9d-48e1-a817-28f72815c646,DeviceId=9d2bddae-d38c-404e-81fd-79807b82598f,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_036b0e2d-319b-4b26-a6c1-676f9952948f=VmId=e5a192f1-3f9d-48e1-a817-28f72815c646,DeviceId=036b0e2d-319b-4b26-a6c1-676f9952948f,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0} >2012-08-07 14:51:30,180 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [2157649] FINISH, CreateVDSCommand, log id: 355556e5 >2012-08-07 14:51:30,190 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [2157649] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 5. Vm: pool1-12 >2012-08-07 14:51:30,277 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:30,279 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [2157649] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 6a8ac42a >2012-08-07 14:51:30,291 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [2157649] Before releasing a lock EngineLock [exclusiveLocks= key: e5a192f1-3f9d-48e1-a817-28f72815c646 value: VM >, sharedLocks= ] >2012-08-07 14:51:30,301 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [2157649] The exclusive lock for key e5a192f1-3f9d-48e1-a817-28f72815c646VM is released and lock is removed from map >2012-08-07 14:51:30,308 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [2157649] Lock freed to object EngineLock [exclusiveLocks= key: e5a192f1-3f9d-48e1-a817-28f72815c646 value: VM >, sharedLocks= ] >2012-08-07 14:51:30,493 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [e953114] Running command: RunVmCommand internal: false. Entities affected : ID: 8738bb81-c73e-4a41-a24a-c4c49491c536 Type: VM >2012-08-07 14:51:30,507 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [e953114] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 2,560 MB >2012-08-07 14:51:30,513 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [e953114] Host Mem Conmmitted: 2,885, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:30,520 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [e953114] 6,343 <= ??? 9,881 >2012-08-07 14:51:30,558 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [e953114] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=8738bb81-c73e-4a41-a24a-c4c49491c536, vm=org.ovirt.engine.core.common.businessentities.VM@7eb345d5), log id: 5cc4d5d7 >2012-08-07 14:51:30,573 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [e953114] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=8738bb81-c73e-4a41-a24a-c4c49491c536, vm=org.ovirt.engine.core.common.businessentities.VM@7eb345d5), log id: 1ee459f1 >2012-08-07 14:51:30,701 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [e953114] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=8738bb81-c73e-4a41-a24a-c4c49491c536,devices=[Ljava.util.Map;@2ecc42e6,acpiEnable=true,vmName=pool1-9,cpuType=Conroe,custom={device_121554a1-e556-4a4b-80e0-a11ff96fa37adevice_db280bdd-fbd9-492c-b24e-736e169fbc3fdevice_cd108684-ffa3-4f9a-9fb6-4be7f0567f02device_40ab9c53-72ec-4214-af51-fc91af0b450c=VmId=8738bb81-c73e-4a41-a24a-c4c49491c536,DeviceId=40ab9c53-72ec-4214-af51-fc91af0b450c,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_121554a1-e556-4a4b-80e0-a11ff96fa37adevice_db280bdd-fbd9-492c-b24e-736e169fbc3f=VmId=8738bb81-c73e-4a41-a24a-c4c49491c536,DeviceId=db280bdd-fbd9-492c-b24e-736e169fbc3f,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_121554a1-e556-4a4b-80e0-a11ff96fa37adevice_db280bdd-fbd9-492c-b24e-736e169fbc3fdevice_cd108684-ffa3-4f9a-9fb6-4be7f0567f02device_40ab9c53-72ec-4214-af51-fc91af0b450cdevice_821a50a9-1f04-42d8-a23f-21f655a87a76=VmId=8738bb81-c73e-4a41-a24a-c4c49491c536,DeviceId=821a50a9-1f04-42d8-a23f-21f655a87a76,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_121554a1-e556-4a4b-80e0-a11ff96fa37a=VmId=8738bb81-c73e-4a41-a24a-c4c49491c536,DeviceId=121554a1-e556-4a4b-80e0-a11ff96fa37a,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_121554a1-e556-4a4b-80e0-a11ff96fa37adevice_db280bdd-fbd9-492c-b24e-736e169fbc3fdevice_cd108684-ffa3-4f9a-9fb6-4be7f0567f02=VmId=8738bb81-c73e-4a41-a24a-c4c49491c536,DeviceId=cd108684-ffa3-4f9a-9fb6-4be7f0567f02,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0} >2012-08-07 14:51:30,763 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [e953114] FINISH, CreateVDSCommand, log id: 1ee459f1 >2012-08-07 14:51:30,773 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [e953114] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 6. Vm: pool1-9 >2012-08-07 14:51:31,010 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [e953114] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 5cc4d5d7 >2012-08-07 14:51:31,015 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [e953114] Before releasing a lock EngineLock [exclusiveLocks= key: 8738bb81-c73e-4a41-a24a-c4c49491c536 value: VM >, sharedLocks= ] >2012-08-07 14:51:31,022 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [e953114] The exclusive lock for key 8738bb81-c73e-4a41-a24a-c4c49491c536VM is released and lock is removed from map >2012-08-07 14:51:31,028 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [e953114] Lock freed to object EngineLock [exclusiveLocks= key: 8738bb81-c73e-4a41-a24a-c4c49491c536 value: VM >, sharedLocks= ] >2012-08-07 14:51:31,245 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [7e2e8de3] Running command: RunVmCommand internal: false. Entities affected : ID: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 Type: VM >2012-08-07 14:51:31,267 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [7e2e8de3] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 3,072 MB >2012-08-07 14:51:31,272 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [7e2e8de3] Host Mem Conmmitted: 3,462, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:31,279 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [7e2e8de3] 7,432 <= ??? 9,881 >2012-08-07 14:51:31,314 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [7e2e8de3] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5, vm=org.ovirt.engine.core.common.businessentities.VM@3b889237), log id: 7b2cd1e6 >2012-08-07 14:51:31,318 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [7e2e8de3] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5, vm=org.ovirt.engine.core.common.businessentities.VM@3b889237), log id: 1e764313 >2012-08-07 14:51:31,455 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [7e2e8de3] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5,devices=[Ljava.util.Map;@c06abe3,acpiEnable=true,vmName=pool1-8,cpuType=Conroe,custom={device_88c05d62-1757-4ebf-b64b-3ada58aa08bcdevice_0b569ec8-d4ab-4027-9bdc-5cd3b56bb084device_53c43f99-f3e6-4b5c-a7d1-ccf341c536e1device_9a8b156e-2a48-4120-ace4-f6f76a4d4efcdevice_da8ee517-1890-48f6-86cf-bf42611b46d9=VmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5,DeviceId=da8ee517-1890-48f6-86cf-bf42611b46d9,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_88c05d62-1757-4ebf-b64b-3ada58aa08bcdevice_0b569ec8-d4ab-4027-9bdc-5cd3b56bb084=VmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5,DeviceId=0b569ec8-d4ab-4027-9bdc-5cd3b56bb084,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_88c05d62-1757-4ebf-b64b-3ada58aa08bc=VmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5,DeviceId=88c05d62-1757-4ebf-b64b-3ada58aa08bc,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_88c05d62-1757-4ebf-b64b-3ada58aa08bcdevice_0b569ec8-d4ab-4027-9bdc-5cd3b56bb084device_53c43f99-f3e6-4b5c-a7d1-ccf341c536e1device_9a8b156e-2a48-4120-ace4-f6f76a4d4efc=VmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5,DeviceId=9a8b156e-2a48-4120-ace4-f6f76a4d4efc,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_88c05d62-1757-4ebf-b64b-3ada58aa08bcdevice_0b569ec8-d4ab-4027-9bdc-5cd3b56bb084device_53c43f99-f3e6-4b5c-a7d1-ccf341c536e1=VmId=96405d4a-a3bd-4900-ab90-9c8736cb02a5,DeviceId=53c43f99-f3e6-4b5c-a7d1-ccf341c536e1,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0} >2012-08-07 14:51:31,514 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [7e2e8de3] FINISH, CreateVDSCommand, log id: 1e764313 >2012-08-07 14:51:31,525 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [7e2e8de3] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 7. Vm: pool1-8 >2012-08-07 14:51:31,628 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [7e2e8de3] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 7b2cd1e6 >2012-08-07 14:51:31,634 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [7e2e8de3] Before releasing a lock EngineLock [exclusiveLocks= key: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 value: VM >, sharedLocks= ] >2012-08-07 14:51:31,640 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [7e2e8de3] The exclusive lock for key 96405d4a-a3bd-4900-ab90-9c8736cb02a5VM is released and lock is removed from map >2012-08-07 14:51:31,647 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [7e2e8de3] Lock freed to object EngineLock [exclusiveLocks= key: 96405d4a-a3bd-4900-ab90-9c8736cb02a5 value: VM >, sharedLocks= ] >2012-08-07 14:51:31,827 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [1c3dbf7f] Running command: RunVmCommand internal: false. Entities affected : ID: c1cb365c-a119-493c-964c-faf65a10c889 Type: VM >2012-08-07 14:51:31,849 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [1c3dbf7f] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 3,584 MB >2012-08-07 14:51:31,854 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [1c3dbf7f] Host Mem Conmmitted: 4,039, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:31,860 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [1c3dbf7f] 8,521 <= ??? 9,881 >2012-08-07 14:51:31,898 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [1c3dbf7f] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=c1cb365c-a119-493c-964c-faf65a10c889, vm=org.ovirt.engine.core.common.businessentities.VM@4032f65a), log id: 63547e58 >2012-08-07 14:51:32,004 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-48) VM pool1-13 6c1fcddf-86d6-4533-905b-abb11b775f5b moved from WaitForLaunch --> PoweringUp >2012-08-07 14:51:32,006 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-48) VM pool1-3 d3c805a2-419c-480f-8627-f5c9ef5c4117 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:51:32,014 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-48) VM pool1-4 a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:51:32,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-48) START, FullListVdsCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=null, vmIds=[6c1fcddf-86d6-4533-905b-abb11b775f5b, d3c805a2-419c-480f-8627-f5c9ef5c4117, a7d2a056-b67b-4bc5-b8ea-7afef2d2b861]), log id: 293bef8f >2012-08-07 14:51:32,076 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-48) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@1decaa6f, log id: 293bef8f >2012-08-07 14:51:32,212 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:32,285 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [1c3dbf7f] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=c1cb365c-a119-493c-964c-faf65a10c889, vm=org.ovirt.engine.core.common.businessentities.VM@4032f65a), log id: 1c90f547 >2012-08-07 14:51:32,421 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [1c3dbf7f] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=c1cb365c-a119-493c-964c-faf65a10c889,devices=[Ljava.util.Map;@6e1c6f47,acpiEnable=true,vmName=pool1-5,cpuType=Conroe,custom={device_7959a280-45d7-49da-9530-2ec0a60dff1c=VmId=c1cb365c-a119-493c-964c-faf65a10c889,DeviceId=7959a280-45d7-49da-9530-2ec0a60dff1c,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_7959a280-45d7-49da-9530-2ec0a60dff1cdevice_b2234aaa-d292-4b02-8237-e967f071b1d0=VmId=c1cb365c-a119-493c-964c-faf65a10c889,DeviceId=b2234aaa-d292-4b02-8237-e967f071b1d0,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_7959a280-45d7-49da-9530-2ec0a60dff1cdevice_b2234aaa-d292-4b02-8237-e967f071b1d0device_68188558-b159-4246-af3d-ae25331739fcdevice_593ae703-b7b4-4436-a590-d8deb716f637device_58f19f9a-b63b-4b20-8f27-e9356cd5bca4=VmId=c1cb365c-a119-493c-964c-faf65a10c889,DeviceId=58f19f9a-b63b-4b20-8f27-e9356cd5bca4,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_7959a280-45d7-49da-9530-2ec0a60dff1cdevice_b2234aaa-d292-4b02-8237-e967f071b1d0device_68188558-b159-4246-af3d-ae25331739fcdevice_593ae703-b7b4-4436-a590-d8deb716f637=VmId=c1cb365c-a119-493c-964c-faf65a10c889,DeviceId=593ae703-b7b4-4436-a590-d8deb716f637,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_7959a280-45d7-49da-9530-2ec0a60dff1cdevice_b2234aaa-d292-4b02-8237-e967f071b1d0device_68188558-b159-4246-af3d-ae25331739fc=VmId=c1cb365c-a119-493c-964c-faf65a10c889,DeviceId=68188558-b159-4246-af3d-ae25331739fc,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0} >2012-08-07 14:51:32,513 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [1c3dbf7f] FINISH, CreateVDSCommand, log id: 1c90f547 >2012-08-07 14:51:32,529 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [1c3dbf7f] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 8. Vm: pool1-5 >2012-08-07 14:51:32,581 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [1c3dbf7f] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 63547e58 >2012-08-07 14:51:32,582 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [1c3dbf7f] Before releasing a lock EngineLock [exclusiveLocks= key: c1cb365c-a119-493c-964c-faf65a10c889 value: VM >, sharedLocks= ] >2012-08-07 14:51:32,583 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [1c3dbf7f] The exclusive lock for key c1cb365c-a119-493c-964c-faf65a10c889VM is released and lock is removed from map >2012-08-07 14:51:32,590 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [1c3dbf7f] Lock freed to object EngineLock [exclusiveLocks= key: c1cb365c-a119-493c-964c-faf65a10c889 value: VM >, sharedLocks= ] >2012-08-07 14:51:32,729 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [46522d4b] Running command: RunVmCommand internal: false. Entities affected : ID: c7702cf0-88da-4885-9b9c-9e59772b3774 Type: VM >2012-08-07 14:51:32,754 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [46522d4b] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 4,096 MB >2012-08-07 14:51:32,755 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [46522d4b] Host Mem Conmmitted: 4,616, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:32,760 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [46522d4b] 9,610 <= ??? 9,881 >2012-08-07 14:51:32,804 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [46522d4b] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=c7702cf0-88da-4885-9b9c-9e59772b3774, vm=org.ovirt.engine.core.common.businessentities.VM@77571649), log id: 6d8408b2 >2012-08-07 14:51:32,811 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [46522d4b] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=c7702cf0-88da-4885-9b9c-9e59772b3774, vm=org.ovirt.engine.core.common.businessentities.VM@77571649), log id: 66daba44 >2012-08-07 14:51:32,896 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [46522d4b] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=c7702cf0-88da-4885-9b9c-9e59772b3774,devices=[Ljava.util.Map;@227065fe,acpiEnable=true,vmName=pool1-6,cpuType=Conroe,custom={device_a4c7aa56-9bc1-44c7-be30-f134dd9314ecdevice_91f7b0d8-7d36-4457-bb35-d609cb3763cedevice_0a15e216-de18-4708-b0c9-0f56ad1eb1c8=VmId=c7702cf0-88da-4885-9b9c-9e59772b3774,DeviceId=0a15e216-de18-4708-b0c9-0f56ad1eb1c8,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_a4c7aa56-9bc1-44c7-be30-f134dd9314ecdevice_91f7b0d8-7d36-4457-bb35-d609cb3763cedevice_0a15e216-de18-4708-b0c9-0f56ad1eb1c8device_03f0e42a-5f97-459b-a688-606446e03e13device_0ca87de9-7dd9-44bc-99dd-2b10380ac308=VmId=c7702cf0-88da-4885-9b9c-9e59772b3774,DeviceId=0ca87de9-7dd9-44bc-99dd-2b10380ac308,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_a4c7aa56-9bc1-44c7-be30-f134dd9314ecdevice_91f7b0d8-7d36-4457-bb35-d609cb3763cedevice_0a15e216-de18-4708-b0c9-0f56ad1eb1c8device_03f0e42a-5f97-459b-a688-606446e03e13=VmId=c7702cf0-88da-4885-9b9c-9e59772b3774,DeviceId=03f0e42a-5f97-459b-a688-606446e03e13,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_a4c7aa56-9bc1-44c7-be30-f134dd9314ec=VmId=c7702cf0-88da-4885-9b9c-9e59772b3774,DeviceId=a4c7aa56-9bc1-44c7-be30-f134dd9314ec,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_a4c7aa56-9bc1-44c7-be30-f134dd9314ecdevice_91f7b0d8-7d36-4457-bb35-d609cb3763ce=VmId=c7702cf0-88da-4885-9b9c-9e59772b3774,DeviceId=91f7b0d8-7d36-4457-bb35-d609cb3763ce,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0} >2012-08-07 14:51:32,972 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [46522d4b] FINISH, CreateVDSCommand, log id: 66daba44 >2012-08-07 14:51:32,983 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [46522d4b] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 9. Vm: pool1-6 >2012-08-07 14:51:33,021 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [46522d4b] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 6d8408b2 >2012-08-07 14:51:33,026 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [46522d4b] Before releasing a lock EngineLock [exclusiveLocks= key: c7702cf0-88da-4885-9b9c-9e59772b3774 value: VM >, sharedLocks= ] >2012-08-07 14:51:33,033 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [46522d4b] The exclusive lock for key c7702cf0-88da-4885-9b9c-9e59772b3774VM is released and lock is removed from map >2012-08-07 14:51:33,039 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [46522d4b] Lock freed to object EngineLock [exclusiveLocks= key: c7702cf0-88da-4885-9b9c-9e59772b3774 value: VM >, sharedLocks= ] >2012-08-07 14:51:33,216 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [12334d52] Running command: RunVmCommand internal: false. Entities affected : ID: 3ce0f220-6cb8-42d8-b922-7003c60ccdad Type: VM >2012-08-07 14:51:33,231 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [12334d52] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 4,608 MB >2012-08-07 14:51:33,236 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [12334d52] Host Mem Conmmitted: 5,193, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:33,242 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [12334d52] 10,699 <= ??? 9,881 >2012-08-07 14:51:33,245 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [12334d52] Cant find VDS to run the VM 3ce0f220-6cb8-42d8-b922-7003c60ccdad on, so this VM will not be run. >2012-08-07 14:51:33,291 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [12334d52] Command [id=3b50332e-285f-4d3a-8330-9f18eaa38224]: No compensation data. >2012-08-07 14:51:33,297 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [12334d52] Before releasing a lock EngineLock [exclusiveLocks= key: 3ce0f220-6cb8-42d8-b922-7003c60ccdad value: VM >, sharedLocks= ] >2012-08-07 14:51:33,304 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [12334d52] The exclusive lock for key 3ce0f220-6cb8-42d8-b922-7003c60ccdadVM is released and lock is removed from map >2012-08-07 14:51:33,314 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [12334d52] Lock freed to object EngineLock [exclusiveLocks= key: 3ce0f220-6cb8-42d8-b922-7003c60ccdad value: VM >, sharedLocks= ] >2012-08-07 14:51:33,492 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [4bfe0f19] Running command: RunVmCommand internal: false. Entities affected : ID: 6df57989-99a7-4ec9-8f7c-15f222064e61 Type: VM >2012-08-07 14:51:33,507 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [4bfe0f19] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 4,608 MB >2012-08-07 14:51:33,512 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [4bfe0f19] Host Mem Conmmitted: 5,193, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:33,518 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [4bfe0f19] 10,699 <= ??? 9,881 >2012-08-07 14:51:33,522 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [4bfe0f19] Cant find VDS to run the VM 6df57989-99a7-4ec9-8f7c-15f222064e61 on, so this VM will not be run. >2012-08-07 14:51:33,569 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [4bfe0f19] Command [id=0a45dc42-caef-4eb8-8325-7cefa51076f8]: No compensation data. >2012-08-07 14:51:33,575 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [4bfe0f19] Before releasing a lock EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-07 14:51:33,581 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [4bfe0f19] The exclusive lock for key 6df57989-99a7-4ec9-8f7c-15f222064e61VM is released and lock is removed from map >2012-08-07 14:51:33,588 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [4bfe0f19] Lock freed to object EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-07 14:51:33,720 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [a1a58f7] Running command: RunVmCommand internal: false. Entities affected : ID: 5524b98a-aa45-49cb-9d8b-bec3884753c9 Type: VM >2012-08-07 14:51:33,732 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [a1a58f7] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 4,608 MB >2012-08-07 14:51:33,737 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [a1a58f7] Host Mem Conmmitted: 5,193, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:51:33,746 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [a1a58f7] 10,699 <= ??? 9,881 >2012-08-07 14:51:33,751 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [a1a58f7] Cant find VDS to run the VM 5524b98a-aa45-49cb-9d8b-bec3884753c9 on, so this VM will not be run. >2012-08-07 14:51:33,779 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [a1a58f7] Command [id=0184316b-71d4-4243-8f78-22fe0a67d6d9]: No compensation data. >2012-08-07 14:51:33,781 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [a1a58f7] Before releasing a lock EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] >2012-08-07 14:51:33,794 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [a1a58f7] The exclusive lock for key 5524b98a-aa45-49cb-9d8b-bec3884753c9VM is released and lock is removed from map >2012-08-07 14:51:33,806 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [a1a58f7] Lock freed to object EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] >2012-08-07 14:51:34,609 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-56) VM pool1-14 2842672f-6230-434f-8232-e88e71560092 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:51:34,610 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-56) VM pool1-8 96405d4a-a3bd-4900-ab90-9c8736cb02a5 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:51:34,614 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-56) VM pool1-12 e5a192f1-3f9d-48e1-a817-28f72815c646 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:51:34,621 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-56) VM pool1-9 8738bb81-c73e-4a41-a24a-c4c49491c536 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:51:34,627 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-56) START, FullListVdsCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=null, vmIds=[2842672f-6230-434f-8232-e88e71560092, 96405d4a-a3bd-4900-ab90-9c8736cb02a5, e5a192f1-3f9d-48e1-a817-28f72815c646, 8738bb81-c73e-4a41-a24a-c4c49491c536]), log id: 238d6f7e >2012-08-07 14:51:34,666 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-56) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@1a92cb6e, log id: 238d6f7e >2012-08-07 14:51:35,279 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:37,163 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-61) VM pool1-6 c7702cf0-88da-4885-9b9c-9e59772b3774 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:51:37,169 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-61) VM pool1-5 c1cb365c-a119-493c-964c-faf65a10c889 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:51:37,175 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-61) START, FullListVdsCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=null, vmIds=[c7702cf0-88da-4885-9b9c-9e59772b3774, c1cb365c-a119-493c-964c-faf65a10c889]), log id: 37c52870 >2012-08-07 14:51:37,212 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-61) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@70e1edaa, log id: 37c52870 >2012-08-07 14:51:37,222 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:40,268 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:42,217 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:44,306 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-75) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 14:51:44,308 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-75) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 14:51:44,314 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-75) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 14:51:44,322 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-75) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 14:51:45,275 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:47,224 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:50,267 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:52,187 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:55,258 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:51:57,221 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:00,266 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:02,213 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:05,262 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:07,215 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:10,272 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:11,715 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:12,222 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:15,268 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:16,697 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:17,220 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:20,274 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:21,709 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:22,214 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:25,274 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:26,700 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:27,225 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:30,335 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:30,496 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-51) VM pool1-13 6c1fcddf-86d6-4533-905b-abb11b775f5b moved from PoweringUp --> Up >2012-08-07 14:52:30,497 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-51) VM pool1-14 2842672f-6230-434f-8232-e88e71560092 moved from PoweringUp --> Up >2012-08-07 14:52:30,498 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-51) VM pool1-3 d3c805a2-419c-480f-8627-f5c9ef5c4117 moved from PoweringUp --> Up >2012-08-07 14:52:30,501 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-51) VM pool1-4 a7d2a056-b67b-4bc5-b8ea-7afef2d2b861 moved from PoweringUp --> Up >2012-08-07 14:52:30,504 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-51) VM pool1-12 e5a192f1-3f9d-48e1-a817-28f72815c646 moved from PoweringUp --> Up >2012-08-07 14:52:30,545 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-51) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@39d3d033), log id: 37eb3255 >2012-08-07 14:52:30,566 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-51) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 37eb3255 >2012-08-07 14:52:30,569 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-51) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 8. Vm: pool1-13 >2012-08-07 14:52:30,572 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-51) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 4,096. Vm: pool1-13 >2012-08-07 14:52:30,859 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-51) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@a16d7054), log id: 388b8f83 >2012-08-07 14:52:30,991 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-51) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 388b8f83 >2012-08-07 14:52:30,992 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-51) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 7. Vm: pool1-14 >2012-08-07 14:52:30,993 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-51) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 3,584. Vm: pool1-14 >2012-08-07 14:52:31,026 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-51) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@9071075), log id: 129a3666 >2012-08-07 14:52:31,126 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-51) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 129a3666 >2012-08-07 14:52:31,126 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-51) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 6. Vm: pool1-3 >2012-08-07 14:52:31,127 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-51) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 3,072. Vm: pool1-3 >2012-08-07 14:52:31,169 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-51) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@70a0b096), log id: 4d5c37f8 >2012-08-07 14:52:31,190 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-51) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 4d5c37f8 >2012-08-07 14:52:31,193 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-51) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 5. Vm: pool1-4 >2012-08-07 14:52:31,196 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-51) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 2,560. Vm: pool1-4 >2012-08-07 14:52:31,229 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-51) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@d83a50b7), log id: 4b3f467a >2012-08-07 14:52:31,259 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-51) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 4b3f467a >2012-08-07 14:52:31,262 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-51) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 4. Vm: pool1-12 >2012-08-07 14:52:31,265 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-51) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 2,048. Vm: pool1-12 >2012-08-07 14:52:31,698 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:32,217 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:32,925 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) Start time: 8/7/12 2:52 PM. Start running CanDoAction for command number 1/2 (Command type: RunVm) >2012-08-07 14:52:32,926 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 8/7/12 2:52 PM. Start running CanDoAction for command number 2/2 (Command type: RunVm) >2012-08-07 14:52:32,931 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 5524b98a-aa45-49cb-9d8b-bec3884753c9 >2012-08-07 14:52:32,942 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) Before acquiring lock EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] >2012-08-07 14:52:32,944 DEBUG [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-44) Found permission 6f473242-dee5-11e1-a2eb-2bdef96c13bb for user when running RunVm, on VM with id 6df57989-99a7-4ec9-8f7c-15f222064e61 >2012-08-07 14:52:32,948 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-44) Before acquiring lock EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-07 14:52:32,949 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-44) Successed acquiring lock EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:52:32,950 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-44) Lock Acquired to object EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-07 14:52:32,950 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) Successed acquiring lock EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] succeeded >2012-08-07 14:52:32,954 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) Lock Acquired to object EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] >2012-08-07 14:52:32,972 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-44) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4108c211 >2012-08-07 14:52:32,974 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) START, IsValidVDSCommand(storagePoolId = efe20197-e0a7-49b8-beb4-19b1ed3f8c3f, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4261974a >2012-08-07 14:52:32,981 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-45) FINISH, IsValidVDSCommand, return: true, log id: 4261974a >2012-08-07 14:52:32,985 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-44) FINISH, IsValidVDSCommand, return: true, log id: 4108c211 >2012-08-07 14:52:33,038 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-44) START, IsVmDuringInitiatingVDSCommand(vmId = 6df57989-99a7-4ec9-8f7c-15f222064e61), log id: c13563f >2012-08-07 14:52:33,039 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-44) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: c13563f >2012-08-07 14:52:33,049 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) START, IsVmDuringInitiatingVDSCommand(vmId = 5524b98a-aa45-49cb-9d8b-bec3884753c9), log id: 294bf1e8 >2012-08-07 14:52:33,050 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-3-thread-45) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 294bf1e8 >2012-08-07 14:52:33,053 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 2,048 MB >2012-08-07 14:52:33,055 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) Host Mem Conmmitted: 5,193, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:52:33,058 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) 8,139 <= ??? 9,881 >2012-08-07 14:52:33,062 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 8/7/12 2:52 PM. Finish handling CanDoAction for command number 2/2 (Command type: RunVm) >2012-08-07 14:52:33,078 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-44) hasMemoryToRunVM: host purple-vds2 pending vmem size is : 2,048 MB >2012-08-07 14:52:33,079 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-44) Host Mem Conmmitted: 5,193, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:52:33,079 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-44) 8,139 <= ??? 9,881 >2012-08-07 14:52:33,084 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-44) End time: 8/7/12 2:52 PM. Finish handling CanDoAction for command number 1/2 (Command type: RunVm) >2012-08-07 14:52:33,152 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [3245beaa] Running command: RunVmCommand internal: false. Entities affected : ID: 6df57989-99a7-4ec9-8f7c-15f222064e61 Type: VM >2012-08-07 14:52:33,160 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [3245beaa] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 2,048 MB >2012-08-07 14:52:33,161 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [3245beaa] Host Mem Conmmitted: 5,193, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:52:33,162 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [3245beaa] 8,139 <= ??? 9,881 >2012-08-07 14:52:33,204 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [3245beaa] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6df57989-99a7-4ec9-8f7c-15f222064e61, vm=org.ovirt.engine.core.common.businessentities.VM@28024a8d), log id: 5c4c95da >2012-08-07 14:52:33,208 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [3245beaa] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=6df57989-99a7-4ec9-8f7c-15f222064e61, vm=org.ovirt.engine.core.common.businessentities.VM@28024a8d), log id: 4940600 >2012-08-07 14:52:33,272 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [3245beaa] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=6df57989-99a7-4ec9-8f7c-15f222064e61,devices=[Ljava.util.Map;@2b9d0089,acpiEnable=true,vmName=pool1-2,cpuType=Conroe,custom={device_95ff5d5c-d403-4c15-8ce8-74a01e88bf04device_b330897b-aa27-4ce5-9345-bc96b6418e6f=VmId=6df57989-99a7-4ec9-8f7c-15f222064e61,DeviceId=b330897b-aa27-4ce5-9345-bc96b6418e6f,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_95ff5d5c-d403-4c15-8ce8-74a01e88bf04device_b330897b-aa27-4ce5-9345-bc96b6418e6fdevice_965db112-fe9e-4e07-b9f5-e5647e2e47ecdevice_8b562d5e-2939-4215-bc03-8b8211dad381=VmId=6df57989-99a7-4ec9-8f7c-15f222064e61,DeviceId=8b562d5e-2939-4215-bc03-8b8211dad381,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_95ff5d5c-d403-4c15-8ce8-74a01e88bf04device_b330897b-aa27-4ce5-9345-bc96b6418e6fdevice_965db112-fe9e-4e07-b9f5-e5647e2e47ecdevice_8b562d5e-2939-4215-bc03-8b8211dad381device_0bfa3536-603a-45a8-af42-fbb1b0846c4c=VmId=6df57989-99a7-4ec9-8f7c-15f222064e61,DeviceId=0bfa3536-603a-45a8-af42-fbb1b0846c4c,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_95ff5d5c-d403-4c15-8ce8-74a01e88bf04=VmId=6df57989-99a7-4ec9-8f7c-15f222064e61,DeviceId=95ff5d5c-d403-4c15-8ce8-74a01e88bf04,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0, device_95ff5d5c-d403-4c15-8ce8-74a01e88bf04device_b330897b-aa27-4ce5-9345-bc96b6418e6fdevice_965db112-fe9e-4e07-b9f5-e5647e2e47ec=VmId=6df57989-99a7-4ec9-8f7c-15f222064e61,DeviceId=965db112-fe9e-4e07-b9f5-e5647e2e47ec,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0} >2012-08-07 14:52:33,302 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [3245beaa] FINISH, CreateVDSCommand, log id: 4940600 >2012-08-07 14:52:33,309 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [3245beaa] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 5. Vm: pool1-2 >2012-08-07 14:52:33,387 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [3245beaa] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 5c4c95da >2012-08-07 14:52:33,398 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [3245beaa] Before releasing a lock EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-07 14:52:33,402 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [3245beaa] The exclusive lock for key 6df57989-99a7-4ec9-8f7c-15f222064e61VM is released and lock is removed from map >2012-08-07 14:52:33,408 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [3245beaa] Lock freed to object EngineLock [exclusiveLocks= key: 6df57989-99a7-4ec9-8f7c-15f222064e61 value: VM >, sharedLocks= ] >2012-08-07 14:52:33,540 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [fda4371] Running command: RunVmCommand internal: false. Entities affected : ID: 5524b98a-aa45-49cb-9d8b-bec3884753c9 Type: VM >2012-08-07 14:52:33,547 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-53) VM pool1-6 c7702cf0-88da-4885-9b9c-9e59772b3774 moved from PoweringUp --> Up >2012-08-07 14:52:33,548 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-53) VM pool1-8 96405d4a-a3bd-4900-ab90-9c8736cb02a5 moved from PoweringUp --> Up >2012-08-07 14:52:33,549 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-53) VM pool1-9 8738bb81-c73e-4a41-a24a-c4c49491c536 moved from PoweringUp --> Up >2012-08-07 14:52:33,555 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-53) VM pool1-5 c1cb365c-a119-493c-964c-faf65a10c889 moved from PoweringUp --> Up >2012-08-07 14:52:33,558 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [fda4371] hasMemoryToRunVM: host purple-vds2 pending vmem size is : 2,560 MB >2012-08-07 14:52:33,560 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [fda4371] Host Mem Conmmitted: 5,770, Host Reserved Mem: 321, Host Guest Overhead 65, VM Min Allocated Mem 512 >2012-08-07 14:52:33,561 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (pool-3-thread-45) [fda4371] 9,228 <= ??? 9,881 >2012-08-07 14:52:33,587 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-53) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@6540a87a), log id: 30588c6a >2012-08-07 14:52:33,602 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [fda4371] START, CreateVmVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=5524b98a-aa45-49cb-9d8b-bec3884753c9, vm=org.ovirt.engine.core.common.businessentities.VM@7b62e5a1), log id: 763a82d2 >2012-08-07 14:52:33,612 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-53) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 30588c6a >2012-08-07 14:52:33,615 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-53) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 4. Vm: pool1-6 >2012-08-07 14:52:33,618 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-53) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 2,048. Vm: pool1-6 >2012-08-07 14:52:33,656 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-53) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@ccda489b), log id: 6a3f83f1 >2012-08-07 14:52:33,673 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-53) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 6a3f83f1 >2012-08-07 14:52:33,676 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-53) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 3. Vm: pool1-8 >2012-08-07 14:52:33,679 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-53) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 1,536. Vm: pool1-8 >2012-08-07 14:52:33,725 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-53) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@3473e8bc), log id: 5ec1f6ef >2012-08-07 14:52:33,741 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-53) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 5ec1f6ef >2012-08-07 14:52:33,744 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-53) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 2. Vm: pool1-9 >2012-08-07 14:52:33,747 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-53) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 1,024. Vm: pool1-9 >2012-08-07 14:52:33,814 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-53) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@9c0d88dd), log id: 63e773f2 >2012-08-07 14:52:33,836 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-53) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 63e773f2 >2012-08-07 14:52:33,839 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-53) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 1. Vm: pool1-5 >2012-08-07 14:52:33,842 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-53) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 512. Vm: pool1-5 >2012-08-07 14:52:33,898 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [fda4371] START, CreateVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vmId=5524b98a-aa45-49cb-9d8b-bec3884753c9, vm=org.ovirt.engine.core.common.businessentities.VM@7b62e5a1), log id: 6be92a01 >2012-08-07 14:52:34,029 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [fda4371] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,timeOffset=-43200,transparentHugePages=true,vmId=5524b98a-aa45-49cb-9d8b-bec3884753c9,devices=[Ljava.util.Map;@6eefe63b,acpiEnable=true,vmName=pool1-15,cpuType=Conroe,custom={device_040336ca-af20-4c48-8de6-7aa07a977b3cdevice_9706c3f2-c5bf-44fc-a46e-de958e6497f7device_381d1570-6519-47fd-826b-a35415503e74device_0e25cc1e-6f85-4351-b83c-828970c38e7ddevice_0345a2e6-54a1-4fa5-8f4e-917eaafba406=VmId=5524b98a-aa45-49cb-9d8b-bec3884753c9,DeviceId=0345a2e6-54a1-4fa5-8f4e-917eaafba406,Device=spicevmc,Type=channel,BootOrder=0,SpecParams={},Address={port=2, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel1, device_040336ca-af20-4c48-8de6-7aa07a977b3cdevice_9706c3f2-c5bf-44fc-a46e-de958e6497f7device_381d1570-6519-47fd-826b-a35415503e74device_0e25cc1e-6f85-4351-b83c-828970c38e7d=VmId=5524b98a-aa45-49cb-9d8b-bec3884753c9,DeviceId=0e25cc1e-6f85-4351-b83c-828970c38e7d,Device=unix,Type=channel,BootOrder=0,SpecParams={},Address={port=1, bus=0, controller=0, type=virtio-serial},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=channel0, device_040336ca-af20-4c48-8de6-7aa07a977b3cdevice_9706c3f2-c5bf-44fc-a46e-de958e6497f7=VmId=5524b98a-aa45-49cb-9d8b-bec3884753c9,DeviceId=9706c3f2-c5bf-44fc-a46e-de958e6497f7,Device=ide,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=ide0, device_040336ca-af20-4c48-8de6-7aa07a977b3cdevice_9706c3f2-c5bf-44fc-a46e-de958e6497f7device_381d1570-6519-47fd-826b-a35415503e74=VmId=5524b98a-aa45-49cb-9d8b-bec3884753c9,DeviceId=381d1570-6519-47fd-826b-a35415503e74,Device=virtio-serial,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=virtio-serial0, device_040336ca-af20-4c48-8de6-7aa07a977b3c=VmId=5524b98a-aa45-49cb-9d8b-bec3884753c9,DeviceId=040336ca-af20-4c48-8de6-7aa07a977b3c,Device=usb,Type=controller,BootOrder=0,SpecParams={},Address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x2},IsManaged=false,IsPlugged=true,IsReadOnly=false,alias=usb0} >2012-08-07 14:52:34,058 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-45) [fda4371] FINISH, CreateVDSCommand, log id: 6be92a01 >2012-08-07 14:52:34,067 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [fda4371] IncreasePendingVms::CreateVmIncreasing vds purple-vds2 pending vcpu count, now 2. Vm: pool1-15 >2012-08-07 14:52:34,142 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-45) [fda4371] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 763a82d2 >2012-08-07 14:52:34,145 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [fda4371] Before releasing a lock EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] >2012-08-07 14:52:34,149 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (pool-3-thread-45) [fda4371] The exclusive lock for key 5524b98a-aa45-49cb-9d8b-bec3884753c9VM is released and lock is removed from map >2012-08-07 14:52:34,152 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-45) [fda4371] Lock freed to object EngineLock [exclusiveLocks= key: 5524b98a-aa45-49cb-9d8b-bec3884753c9 value: VM >, sharedLocks= ] >2012-08-07 14:52:35,390 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:35,979 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-71) VM pool1-15 5524b98a-aa45-49cb-9d8b-bec3884753c9 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:52:35,980 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-71) VM pool1-2 6df57989-99a7-4ec9-8f7c-15f222064e61 moved from WaitForLaunch --> PoweringUp >2012-08-07 14:52:35,984 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-71) START, FullListVdsCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vds=null, vmIds=[5524b98a-aa45-49cb-9d8b-bec3884753c9, 6df57989-99a7-4ec9-8f7c-15f222064e61]), log id: e274ba7 >2012-08-07 14:52:36,010 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-71) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@35d7c833, log id: e274ba7 >2012-08-07 14:52:36,699 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:37,228 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:40,282 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:41,710 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:42,225 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:44,329 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-77) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 14:52:44,339 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-77) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 14:52:44,339 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-77) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 14:52:44,340 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-77) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 14:52:45,630 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:46,697 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:47,213 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:50,268 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:51,704 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:52,219 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:55,271 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:56,725 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:52:57,226 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:00,271 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:01,699 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:02,221 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:05,267 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:06,698 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:07,230 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:10,272 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:11,748 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:12,268 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:15,268 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:16,859 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:17,228 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:20,268 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:21,708 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:22,221 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:25,266 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:26,759 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:27,376 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:30,268 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:31,701 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:32,224 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:34,472 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-61) VM pool1-15 5524b98a-aa45-49cb-9d8b-bec3884753c9 moved from PoweringUp --> Up >2012-08-07 14:53:34,473 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-61) VM pool1-2 6df57989-99a7-4ec9-8f7c-15f222064e61 moved from PoweringUp --> Up >2012-08-07 14:53:34,517 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-61) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@48d37846), log id: 18b54cf6 >2012-08-07 14:53:34,587 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-61) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 18b54cf6 >2012-08-07 14:53:34,590 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-61) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 1. Vm: pool1-15 >2012-08-07 14:53:34,593 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-61) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 512. Vm: pool1-15 >2012-08-07 14:53:34,652 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-61) START, UpdateVdsDynamicDataVDSCommand(vdsId = 4196a566-dee6-11e1-b66e-c35c5273fee7, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@b06d1867), log id: 7d22d572 >2012-08-07 14:53:34,676 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-61) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 7d22d572 >2012-08-07 14:53:34,678 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-61) DecreasePendingVms::Decreasing vds purple-vds2 pending vcpu count, now 0. Vm: pool1-2 >2012-08-07 14:53:34,681 DEBUG [org.ovirt.engine.core.bll.RunVmCommandBase] (QuartzScheduler_Worker-61) DecreasePendingVms::Decreasing vds purple-vds2 pending vmem size, now 0. Vm: pool1-2 >2012-08-07 14:53:35,268 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:36,710 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:37,496 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:40,276 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:41,809 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:42,216 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:44,343 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-76) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 14:53:44,351 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-76) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 14:53:44,351 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-76) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 14:53:44,352 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-76) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 14:53:45,272 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:46,711 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:47,214 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:50,268 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:51,698 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:52,214 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:55,270 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:56,697 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:53:57,422 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:00,272 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:01,696 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:02,223 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:05,271 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:06,661 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:07,215 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:10,268 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:11,648 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:12,214 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:15,267 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:16,891 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:17,386 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:20,265 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:21,703 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:22,220 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:25,267 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:26,711 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:27,218 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:30,266 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:31,792 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:32,445 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:35,266 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:36,837 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:37,233 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:40,273 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:41,651 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:42,356 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:44,356 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-81) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 14:54:44,358 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-81) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 14:54:44,361 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-81) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 14:54:44,364 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-81) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 14:54:45,264 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:46,798 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:47,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:50,270 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:51,701 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:52,219 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:55,269 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:56,939 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:54:57,182 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Checking autorecoverable hosts >2012-08-07 14:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Autorecovering 0 hosts >2012-08-07 14:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Checking autorecoverable hosts done >2012-08-07 14:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Checking autorecoverable storage domains >2012-08-07 14:55:00,053 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Autorecovering 1 storage domains >2012-08-07 14:55:00,053 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 14:55:00,054 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [1a7bfc9e] Permission check skipped for internal action ActivateStorageDomain. >2012-08-07 14:55:00,056 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-12) [1a7bfc9e] Before acquiring lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:55:00,063 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-12) [1a7bfc9e] Successed acquiring lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] succeeded >2012-08-07 14:55:00,069 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [1a7bfc9e] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:55:00,116 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [1a7bfc9e] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 14:55:00,167 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-12) [1a7bfc9e] Before releasing a lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:55:00,170 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-12) [1a7bfc9e] The exclusive lock for key 99bb665e-3421-4afb-bf70-d7b879c591b3STORAGE is released and lock is removed from map >2012-08-07 14:55:00,174 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [1a7bfc9e] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 14:55:00,178 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [1a7bfc9e] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 2:55 PM >2012-08-07 14:55:00,196 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [1a7bfc9e] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 769d2085 >2012-08-07 14:55:00,292 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:01,700 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:02,224 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:05,267 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:06,710 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:07,219 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:10,268 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:11,878 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:12,170 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:15,266 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:16,698 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:17,212 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:20,266 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:21,698 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:22,211 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:25,265 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:26,702 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:27,216 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:30,265 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:31,707 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:32,220 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:35,266 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:36,821 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:37,761 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:40,273 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:41,680 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:42,229 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:44,368 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-85) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 14:55:44,374 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-85) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 14:55:44,375 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-85) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 14:55:44,376 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-85) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 14:55:45,265 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:46,721 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:47,213 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:50,280 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:51,711 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:52,227 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:55,265 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:56,707 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:55:57,223 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:00,286 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:01,682 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:02,235 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:05,266 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:06,701 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:07,244 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:10,268 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:11,727 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:12,239 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:15,264 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:16,734 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:17,234 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:20,265 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:21,679 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:22,239 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:25,264 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:26,749 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:27,218 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:30,266 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:31,730 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:32,250 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:35,266 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:36,708 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:37,246 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:40,280 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:41,743 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:42,407 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:44,377 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-89) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 14:56:44,379 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-89) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 14:56:44,382 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-89) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 14:56:44,383 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-89) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 14:56:45,263 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:46,732 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:47,220 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:50,263 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:51,699 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:52,215 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:55,303 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:56,795 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:56:57,164 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:00,262 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:01,716 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:02,219 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:05,268 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:06,719 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:07,223 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:10,263 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:11,708 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:12,238 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:15,263 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:16,705 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:17,232 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:20,263 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:21,718 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:22,226 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:25,263 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:26,714 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:27,223 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:30,262 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:31,715 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:32,216 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:35,266 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:36,703 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:37,228 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:40,254 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:41,787 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:42,230 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:44,386 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-92) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 14:57:44,389 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-92) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 14:57:44,392 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-92) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 14:57:44,395 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-92) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 14:57:45,400 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:46,711 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:47,236 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:50,259 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:51,698 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:52,218 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:55,266 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:56,660 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:57:57,216 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:00,201 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [1a7bfc9e] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 14:58:00,205 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [1a7bfc9e] FINISH, ConnectStorageServerVDSCommand, log id: 769d2085 >2012-08-07 14:58:00,208 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [1a7bfc9e] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 14:58:00,261 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:00,271 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [1a7bfc9e] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 2:58 PM >2012-08-07 14:58:00,273 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-12) [1a7bfc9e] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 4a6cf268 >2012-08-07 14:58:00,569 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-12) [1a7bfc9e] Failed in ActivateStorageDomainVDS method >2012-08-07 14:58:00,570 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-12) [1a7bfc9e] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:58:00,571 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) [1a7bfc9e] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:58:00,581 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-12) [1a7bfc9e] FINISH, ActivateStorageDomainVDSCommand, log id: 4a6cf268 >2012-08-07 14:58:00,584 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [1a7bfc9e] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 14:58:00,593 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [1a7bfc9e] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand.executeCommand(ActivateStorageDomainCommand.java:67) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteWithoutTransaction(CommandBase.java:810) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:901) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1256) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:168) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:107) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.Execute(CommandBase.java:916) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteAction(CommandBase.java:275) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:335) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:288) [engine-bll.jar:] > at sun.reflect.GeneratedMethodAccessor140.invoke(Unknown Source) [:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.check(AutoRecoveryManager.java:96) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.onTimer(AutoRecoveryManager.java:63) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:64) [engine-scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz-2.1.2.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz-2.1.2.jar:] > >2012-08-07 14:58:00,704 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [1a7bfc9e] Command [id=a816b96c-9c4b-42a6-a860-570af2e9beef]: Going over compensation data. >2012-08-07 14:58:00,716 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-12) [1a7bfc9e] Command [id=a816b96c-9c4b-42a6-a860-570af2e9beef]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 14:58:00,747 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) [1a7bfc9e] Checking autorecoverable storage domains done >2012-08-07 14:58:01,709 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:02,226 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:05,263 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:06,716 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:07,261 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:10,264 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:11,798 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:12,222 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:15,262 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:16,702 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:17,481 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:20,262 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:21,714 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:22,225 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:25,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:26,724 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:27,220 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:30,264 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:31,719 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:32,236 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:35,263 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:36,715 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:37,220 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:40,261 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:41,697 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:42,214 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:44,399 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-100) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 14:58:44,401 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-100) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 14:58:44,402 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-100) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 14:58:44,403 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-100) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 14:58:45,262 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:46,744 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:47,230 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:50,261 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:51,699 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:52,223 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:55,261 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:56,762 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:58:57,221 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:00,240 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:01,654 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:02,477 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:05,262 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:06,707 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:07,222 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:10,265 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:11,637 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:12,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:15,259 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:16,719 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:17,224 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:20,262 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:21,716 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:22,272 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:25,391 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:26,731 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:27,227 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:30,261 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:31,684 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:32,202 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:35,261 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:36,708 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:37,276 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:40,259 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:41,718 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:42,232 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:44,405 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-3) [10c6182a] VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 14:59:44,408 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-3) [10c6182a] VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 14:59:44,411 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-3) [10c6182a] VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 14:59:44,414 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-3) [10c6182a] VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 14:59:45,259 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:46,728 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:47,399 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:50,259 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:51,701 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:52,216 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:55,260 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:56,714 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 14:59:57,218 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Checking autorecoverable hosts >2012-08-07 15:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Autorecovering 0 hosts >2012-08-07 15:00:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Checking autorecoverable hosts done >2012-08-07 15:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Checking autorecoverable storage domains >2012-08-07 15:00:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Autorecovering 1 storage domains >2012-08-07 15:00:00,029 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 15:00:00,036 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [797f5405] Permission check skipped for internal action ActivateStorageDomain. >2012-08-07 15:00:00,045 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-33) [797f5405] Before acquiring lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 15:00:00,060 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-33) [797f5405] Successed acquiring lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] succeeded >2012-08-07 15:00:00,066 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [797f5405] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 15:00:00,119 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [797f5405] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 15:00:00,141 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-33) [797f5405] Before releasing a lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 15:00:00,142 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-33) [797f5405] The exclusive lock for key 99bb665e-3421-4afb-bf70-d7b879c591b3STORAGE is released and lock is removed from map >2012-08-07 15:00:00,143 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [797f5405] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 15:00:00,148 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [797f5405] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 3:00 PM >2012-08-07 15:00:00,188 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [797f5405] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 24bc8fe3 >2012-08-07 15:00:00,264 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:01,713 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:02,228 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:05,260 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:06,663 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:07,228 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:10,263 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:11,699 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:12,486 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:15,260 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:16,705 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:17,233 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:20,260 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:21,704 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:22,216 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:25,444 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:26,856 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:27,449 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:30,519 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:31,710 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:32,225 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:35,261 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:36,701 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:37,235 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:40,262 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:41,706 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:42,218 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:44,417 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-5) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 15:00:44,420 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-5) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 15:00:44,421 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-5) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 15:00:44,421 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-5) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 15:00:45,261 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:46,701 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:47,223 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:50,260 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:51,752 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:52,318 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:55,269 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:56,782 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:00:57,294 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:00,258 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:01,713 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:02,221 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:05,260 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:06,707 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:07,216 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:10,261 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:11,711 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:12,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:15,258 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:16,706 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:17,239 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:20,258 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:21,711 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:22,438 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:25,464 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:26,687 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:27,217 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:30,259 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:31,725 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:32,224 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:35,258 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:36,698 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:37,344 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:40,258 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:41,713 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:42,218 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:44,422 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-7) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 15:01:44,425 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-7) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 15:01:44,428 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-7) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 15:01:44,431 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-7) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 15:01:45,263 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:46,712 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:47,227 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:50,258 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:51,783 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:52,216 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:55,259 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:56,838 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:01:57,280 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:00,259 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:01,731 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:02,231 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:05,257 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:06,715 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:07,212 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:10,257 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:11,670 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:12,216 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:15,259 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:16,727 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:17,230 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:20,256 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:21,718 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:22,228 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:25,381 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:26,689 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:27,281 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:30,260 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:31,684 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:32,233 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:35,253 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:36,742 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:37,215 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:40,260 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:41,703 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:42,222 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:44,434 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-6) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 15:02:44,437 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-6) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 15:02:44,440 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-6) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 15:02:44,443 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-6) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 15:02:45,269 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:46,701 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:47,227 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:50,260 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:51,703 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:52,216 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:55,261 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:56,702 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:02:57,216 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:00,194 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-46) [797f5405] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 15:03:00,197 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-46) [797f5405] FINISH, ConnectStorageServerVDSCommand, log id: 24bc8fe3 >2012-08-07 15:03:00,200 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-46) [797f5405] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 15:03:00,236 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [797f5405] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 3:03 PM >2012-08-07 15:03:00,237 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-33) [797f5405] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 308c7ac0 >2012-08-07 15:03:00,256 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:00,509 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-33) [797f5405] Failed in ActivateStorageDomainVDS method >2012-08-07 15:03:00,510 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-33) [797f5405] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 15:03:00,511 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-33) [797f5405] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 15:03:00,517 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-33) [797f5405] FINISH, ActivateStorageDomainVDSCommand, log id: 308c7ac0 >2012-08-07 15:03:00,520 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [797f5405] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 15:03:00,528 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [797f5405] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand.executeCommand(ActivateStorageDomainCommand.java:67) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteWithoutTransaction(CommandBase.java:810) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:901) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1256) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:168) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:107) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.Execute(CommandBase.java:916) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteAction(CommandBase.java:275) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:335) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:288) [engine-bll.jar:] > at sun.reflect.GeneratedMethodAccessor140.invoke(Unknown Source) [:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.check(AutoRecoveryManager.java:96) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.onTimer(AutoRecoveryManager.java:63) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:64) [engine-scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz-2.1.2.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz-2.1.2.jar:] > >2012-08-07 15:03:00,637 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [797f5405] Command [id=5ed0261f-7ebf-4162-be70-32bd422f6074]: Going over compensation data. >2012-08-07 15:03:00,649 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-33) [797f5405] Command [id=5ed0261f-7ebf-4162-be70-32bd422f6074]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 15:03:00,686 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-33) [797f5405] Checking autorecoverable storage domains done >2012-08-07 15:03:01,784 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:02,226 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:05,257 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:06,705 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:07,436 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:10,257 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:11,702 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:12,217 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:15,260 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:16,662 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:17,230 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:20,258 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:21,699 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:22,226 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:25,411 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:26,701 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:27,224 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:30,613 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:31,700 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:32,217 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:35,261 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:36,700 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:37,228 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:40,261 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:41,700 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:42,229 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:44,446 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-14) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 15:03:44,448 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-14) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 15:03:44,451 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-14) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 15:03:44,460 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-14) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 15:03:45,258 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:46,704 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:47,219 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:50,256 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:51,720 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:52,242 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:55,255 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:56,707 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:03:57,302 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:00,257 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:01,867 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:02,276 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:05,256 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:06,700 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:07,220 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:10,257 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:11,754 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:12,226 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:15,258 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:16,712 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:17,222 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:20,256 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:21,800 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:22,217 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:25,408 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:26,699 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:27,224 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:30,256 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:31,890 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:32,338 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:35,255 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:36,710 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:37,303 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:40,256 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:41,934 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:42,791 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:44,466 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-21) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 15:04:44,468 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-21) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 15:04:44,472 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-21) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 15:04:44,475 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-21) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 15:04:45,254 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:46,703 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:47,237 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:50,254 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:51,703 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:52,229 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:55,255 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:56,709 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:04:57,218 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [7cc5a571] Checking autorecoverable hosts >2012-08-07 15:05:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [7cc5a571] Autorecovering 0 hosts >2012-08-07 15:05:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [7cc5a571] Checking autorecoverable hosts done >2012-08-07 15:05:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [7cc5a571] Checking autorecoverable storage domains >2012-08-07 15:05:00,041 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [7cc5a571] Autorecovering 1 storage domains >2012-08-07 15:05:00,043 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [7cc5a571] Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 15:05:00,046 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [560ffb7b] Permission check skipped for internal action ActivateStorageDomain. >2012-08-07 15:05:00,051 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-26) [560ffb7b] Before acquiring lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 15:05:00,059 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-26) [560ffb7b] Successed acquiring lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] succeeded >2012-08-07 15:05:00,062 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [560ffb7b] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 15:05:00,171 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [560ffb7b] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 15:05:00,204 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-26) [560ffb7b] Before releasing a lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 15:05:00,205 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-26) [560ffb7b] The exclusive lock for key 99bb665e-3421-4afb-bf70-d7b879c591b3STORAGE is released and lock is removed from map >2012-08-07 15:05:00,208 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [560ffb7b] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 15:05:00,223 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [560ffb7b] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 3:05 PM >2012-08-07 15:05:00,255 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:00,291 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [560ffb7b] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 5342430d >2012-08-07 15:05:01,703 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:02,622 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:05,255 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:06,701 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:07,214 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:10,254 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:11,710 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:12,622 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:15,256 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:16,703 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:17,226 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:20,256 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:21,700 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:23,101 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:25,255 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:26,709 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:27,217 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:30,254 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:31,907 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:32,330 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:35,265 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:36,704 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:37,216 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:40,260 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:41,701 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:42,251 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:44,476 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-23) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 15:05:44,480 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-23) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 15:05:44,485 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-23) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 15:05:44,489 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-23) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 15:05:45,269 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:46,773 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:47,185 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:50,258 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:51,707 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:52,216 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:55,258 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:56,717 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:05:57,219 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:00,266 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:02,311 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:02,435 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:05,255 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:06,713 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:07,324 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:10,255 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:11,702 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:12,217 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:15,250 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:16,699 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:17,364 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:20,253 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:21,798 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:22,242 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:25,423 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:26,672 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:27,191 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:30,255 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:31,732 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:32,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:35,257 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:36,741 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:37,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:40,256 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:41,748 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:42,226 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:44,494 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-32) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 15:06:44,496 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-32) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 15:06:44,499 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-32) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 15:06:44,502 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-32) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 15:06:45,257 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:46,710 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:47,269 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:50,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:51,716 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:52,231 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:55,256 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:56,702 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:06:57,223 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:00,253 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:01,712 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:02,218 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:05,254 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:06,710 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:07,213 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:10,254 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:11,712 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:12,216 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:15,253 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:16,703 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:17,215 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:20,255 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:21,705 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:22,219 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:25,253 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:26,717 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:27,219 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:30,252 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:32,085 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:32,194 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:35,252 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:36,723 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:37,221 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:40,252 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:41,757 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:42,221 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:44,504 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-35) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 15:07:44,506 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-35) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 15:07:44,509 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-35) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 15:07:44,512 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-35) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 15:07:45,250 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:46,704 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:47,302 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:50,251 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:51,714 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:52,217 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:55,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:56,753 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:07:57,243 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:00,259 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:00,301 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-45) [560ffb7b] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 15:08:00,303 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [560ffb7b] FINISH, ConnectStorageServerVDSCommand, log id: 5342430d >2012-08-07 15:08:00,306 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-45) [560ffb7b] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 15:08:00,354 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [560ffb7b] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 3:08 PM >2012-08-07 15:08:00,356 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-26) [560ffb7b] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 4e0b64b4 >2012-08-07 15:08:00,636 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-26) [560ffb7b] Failed in ActivateStorageDomainVDS method >2012-08-07 15:08:00,638 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-26) [560ffb7b] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 15:08:00,648 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) [560ffb7b] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 15:08:00,666 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-26) [560ffb7b] FINISH, ActivateStorageDomainVDSCommand, log id: 4e0b64b4 >2012-08-07 15:08:00,671 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [560ffb7b] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 15:08:00,696 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [560ffb7b] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand.executeCommand(ActivateStorageDomainCommand.java:67) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteWithoutTransaction(CommandBase.java:810) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:901) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1256) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:168) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:107) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.Execute(CommandBase.java:916) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteAction(CommandBase.java:275) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:335) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:288) [engine-bll.jar:] > at sun.reflect.GeneratedMethodAccessor140.invoke(Unknown Source) [:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.check(AutoRecoveryManager.java:96) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.onTimer(AutoRecoveryManager.java:63) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:64) [engine-scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz-2.1.2.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz-2.1.2.jar:] > >2012-08-07 15:08:00,908 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [560ffb7b] Command [id=266afa4b-bb6c-4d96-bb56-ff7f65ed83f6]: Going over compensation data. >2012-08-07 15:08:00,917 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-26) [560ffb7b] Command [id=266afa4b-bb6c-4d96-bb56-ff7f65ed83f6]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 15:08:00,943 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [560ffb7b] Checking autorecoverable storage domains done >2012-08-07 15:08:01,711 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:02,220 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:05,253 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:06,704 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:07,233 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:10,257 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:11,712 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:12,226 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:15,256 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:16,704 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:17,239 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:20,255 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:21,723 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:22,226 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:25,255 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:26,717 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:27,219 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:30,256 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:31,710 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:32,227 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:35,246 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:36,723 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:37,216 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:40,260 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:41,736 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:42,217 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:44,515 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-33) [797f5405] VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 15:08:44,517 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-33) [797f5405] VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 15:08:44,521 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-33) [797f5405] VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 15:08:44,524 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-33) [797f5405] VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 15:08:45,252 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:46,702 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:47,221 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:50,251 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:51,708 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:52,219 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:55,251 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:56,672 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:08:57,227 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:00,245 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:01,702 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:02,217 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:05,251 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:06,717 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:07,232 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:10,251 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:11,714 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:12,237 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:15,250 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:16,718 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:17,217 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:20,230 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:21,707 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:22,223 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:25,252 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:26,897 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:27,225 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:30,250 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:31,800 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:32,219 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:35,254 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:36,735 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:37,223 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:40,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:41,704 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:42,226 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:44,526 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-48) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 15:09:44,528 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-48) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 15:09:44,529 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-48) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 15:09:44,532 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-48) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 15:09:45,251 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:46,802 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:47,225 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:50,252 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:51,714 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:52,228 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:55,251 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:56,703 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:09:57,853 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Checking autorecoverable hosts >2012-08-07 15:10:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Autorecovering 0 hosts >2012-08-07 15:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Checking autorecoverable hosts done >2012-08-07 15:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Checking autorecoverable storage domains >2012-08-07 15:10:00,041 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Autorecovering 1 storage domains >2012-08-07 15:10:00,043 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 15:10:00,047 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-78) [39133090] Permission check skipped for internal action ActivateStorageDomain. >2012-08-07 15:10:00,065 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-78) [39133090] Before acquiring lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 15:10:00,073 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-78) [39133090] Successed acquiring lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] succeeded >2012-08-07 15:10:00,079 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-78) [39133090] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 15:10:00,120 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-78) [39133090] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 15:10:00,137 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-78) [39133090] Before releasing a lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 15:10:00,141 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-78) [39133090] The exclusive lock for key 99bb665e-3421-4afb-bf70-d7b879c591b3STORAGE is released and lock is removed from map >2012-08-07 15:10:00,145 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-78) [39133090] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 15:10:00,149 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-78) [39133090] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 3:10 PM >2012-08-07 15:10:00,166 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-41) [39133090] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 9ca1aeb >2012-08-07 15:10:00,250 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:01,704 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:02,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:05,250 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:06,746 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:07,333 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:10,253 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:11,805 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:12,211 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:15,250 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:16,745 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:17,345 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:20,260 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:21,702 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:22,237 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:25,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:26,713 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:27,232 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:30,251 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:31,677 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:32,226 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:35,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:36,704 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:37,189 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:40,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:41,708 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:42,234 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:44,536 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-45) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 15:10:44,539 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-45) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 15:10:44,539 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-45) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 15:10:44,540 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-45) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 15:10:45,254 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:46,721 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:47,224 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:50,241 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:51,716 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:52,219 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:55,251 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:56,707 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:10:57,217 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:00,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:01,714 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:02,479 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:05,260 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:06,702 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:07,226 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:10,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:11,714 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:12,227 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:15,250 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:16,704 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:17,231 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:20,256 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:21,705 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:22,221 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:25,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:26,667 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:27,292 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:30,252 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:31,687 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:32,221 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:35,262 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:36,724 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:37,226 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:40,252 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:41,708 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:42,218 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:44,543 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-54) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 15:11:44,546 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-54) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 15:11:44,546 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-54) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 15:11:44,547 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-54) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 15:11:45,251 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:46,722 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:47,484 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:50,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:51,786 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:52,223 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:55,250 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:56,665 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:11:57,241 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:00,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:01,703 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:02,227 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:05,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:06,709 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:07,219 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:10,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:11,680 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:12,228 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:15,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:16,709 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:17,221 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:20,261 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:21,714 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:22,222 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:25,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:26,707 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:27,241 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:30,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:31,716 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:32,218 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:35,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:36,704 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:37,219 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:40,251 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:41,717 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:42,224 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:44,549 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-39) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 15:12:44,551 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-39) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 15:12:44,554 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-39) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 15:12:44,557 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-39) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 15:12:45,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:46,705 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:47,264 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:50,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:51,709 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:52,218 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:55,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:56,705 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:12:57,217 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:00,173 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-41) [39133090] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 15:13:00,174 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-41) [39133090] FINISH, ConnectStorageServerVDSCommand, log id: 9ca1aeb >2012-08-07 15:13:00,176 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-41) [39133090] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 15:13:00,226 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-78) [39133090] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 3:13 PM >2012-08-07 15:13:00,227 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-78) [39133090] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 574efdb7 >2012-08-07 15:13:00,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:00,507 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-78) [39133090] Failed in ActivateStorageDomainVDS method >2012-08-07 15:13:00,508 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-78) [39133090] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 15:13:00,509 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-78) [39133090] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 15:13:00,517 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-78) [39133090] FINISH, ActivateStorageDomainVDSCommand, log id: 574efdb7 >2012-08-07 15:13:00,521 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-78) [39133090] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 15:13:00,529 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-78) [39133090] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand.executeCommand(ActivateStorageDomainCommand.java:67) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteWithoutTransaction(CommandBase.java:810) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:901) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1256) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:168) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:107) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.Execute(CommandBase.java:916) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteAction(CommandBase.java:275) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:335) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:288) [engine-bll.jar:] > at sun.reflect.GeneratedMethodAccessor140.invoke(Unknown Source) [:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.check(AutoRecoveryManager.java:96) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.onTimer(AutoRecoveryManager.java:63) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:64) [engine-scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz-2.1.2.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz-2.1.2.jar:] > >2012-08-07 15:13:00,639 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-78) [39133090] Command [id=c20de2ac-83db-4e6e-b22a-27fcc5258c88]: Going over compensation data. >2012-08-07 15:13:00,646 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-78) [39133090] Command [id=c20de2ac-83db-4e6e-b22a-27fcc5258c88]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 15:13:00,682 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) [39133090] Checking autorecoverable storage domains done >2012-08-07 15:13:01,704 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:02,217 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:05,246 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:06,704 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:07,218 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:10,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:11,704 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:12,362 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:15,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:16,703 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:17,217 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:20,258 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:21,690 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:22,352 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:25,246 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:26,706 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:27,246 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:30,251 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:31,676 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:32,225 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:35,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:36,713 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:37,225 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:40,251 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:41,703 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:42,217 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:44,560 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-56) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 15:13:44,564 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-56) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 15:13:44,570 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-56) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 15:13:44,576 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-56) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 15:13:45,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:46,716 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:47,228 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:50,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:51,715 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:52,229 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:55,246 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:56,705 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:13:57,228 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:00,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:01,708 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:02,218 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:05,244 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:06,705 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:07,224 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:10,245 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:11,707 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:12,219 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:15,246 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:16,714 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:17,227 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:20,265 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:21,705 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:22,221 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:25,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:26,704 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:27,230 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:30,243 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:31,706 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:32,234 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:35,266 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:36,715 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:37,219 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:40,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:41,703 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:42,223 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:44,577 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-64) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 15:14:44,579 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-64) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 15:14:44,582 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-64) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 15:14:44,585 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-64) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 15:14:45,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:46,904 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:47,235 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:50,245 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:51,715 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:52,206 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:55,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:56,704 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:14:57,229 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable hosts >2012-08-07 15:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Autorecovering 0 hosts >2012-08-07 15:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable hosts done >2012-08-07 15:15:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable storage domains >2012-08-07 15:15:00,030 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Autorecovering 1 storage domains >2012-08-07 15:15:00,031 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 15:15:00,038 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [28ff19f5] Permission check skipped for internal action ActivateStorageDomain. >2012-08-07 15:15:00,043 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-96) [28ff19f5] Before acquiring lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 15:15:00,052 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-96) [28ff19f5] Successed acquiring lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] succeeded >2012-08-07 15:15:00,062 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [28ff19f5] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 15:15:00,109 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [28ff19f5] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 15:15:00,128 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-96) [28ff19f5] Before releasing a lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 15:15:00,137 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-96) [28ff19f5] The exclusive lock for key 99bb665e-3421-4afb-bf70-d7b879c591b3STORAGE is released and lock is removed from map >2012-08-07 15:15:00,141 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [28ff19f5] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 15:15:00,146 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [28ff19f5] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 3:15 PM >2012-08-07 15:15:00,168 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [28ff19f5] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 4d28bbe2 >2012-08-07 15:15:00,244 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:01,658 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:02,221 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:05,246 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:06,739 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:07,227 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:10,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:11,799 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:12,423 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:15,246 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:16,709 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:17,220 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:20,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:21,711 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:22,180 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:25,245 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:26,719 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:27,349 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:30,256 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:31,722 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:32,828 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:35,233 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:37,797 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:37,797 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:40,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:41,705 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:42,286 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:44,587 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-66) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 15:15:44,589 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-66) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 15:15:44,593 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-66) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 15:15:44,596 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-66) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 15:15:45,246 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:46,703 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:47,230 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:50,246 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:51,708 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:52,224 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:55,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:56,795 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:15:57,230 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:00,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:01,793 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:02,230 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:05,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:06,716 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:07,256 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:10,256 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:11,677 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:12,361 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:15,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:16,737 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:17,221 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:20,250 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:21,730 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:22,219 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:25,254 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:26,709 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:27,221 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:30,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:31,721 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:32,263 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:35,244 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:36,705 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:37,220 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:40,253 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:41,718 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:42,222 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:44,600 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-61) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 15:16:44,602 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-61) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 15:16:44,605 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-61) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 15:16:44,609 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-61) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 15:16:45,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:46,710 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:47,252 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:50,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:51,703 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:52,533 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:55,245 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:56,705 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:16:57,231 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:00,252 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:01,716 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:02,238 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:05,217 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:06,709 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:07,368 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:10,252 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:11,681 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:12,222 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:15,245 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:17,539 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:17,870 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:20,265 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:21,788 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:22,970 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:25,245 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:26,895 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:27,434 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:30,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:31,836 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:32,394 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:35,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:36,900 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:37,288 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:40,244 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:41,757 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:42,394 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:44,612 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-86) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 15:17:44,615 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-86) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 15:17:44,616 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-86) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 15:17:44,616 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-86) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 15:17:45,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:46,826 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:47,286 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:50,246 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:51,843 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:52,300 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:55,246 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:56,916 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:17:57,287 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:00,172 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-44) [28ff19f5] XML RPC error in command ConnectStorageServerVDS ( Vds: purple-vds3 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-08-07 15:18:00,173 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-44) [28ff19f5] FINISH, ConnectStorageServerVDSCommand, log id: 4d28bbe2 >2012-08-07 15:18:00,173 ERROR [org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation] (pool-3-thread-44) [28ff19f5] Failed to connect host purple-vds3 to storage pool scsi. Exception: {3}: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:54) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.RunConnectionStorageToDomain(ISCSIStorageHelper.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ISCSIStorageHelper.ConnectStorageToDomainByVdsId(ISCSIStorageHelper.java:223) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ConnectSingleAsyncOperation.Execute(ConnectSingleAsyncOperation.java:18) [engine-bll.jar:] > at org.ovirt.engine.core.utils.SyncronizeNumberOfAsyncOperations$AsyncOpThread.run(SyncronizeNumberOfAsyncOperations.java:30) [engine-utils.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_03-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_03-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_03-icedtea] > >2012-08-07 15:18:00,225 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [28ff19f5] ActivateStorage Domain. After Connect all hosts to pool. Time:8/7/12 3:18 PM >2012-08-07 15:18:00,226 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-96) [28ff19f5] START, ActivateStorageDomainVDSCommand(storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 99bb665e-3421-4afb-bf70-d7b879c591b3), log id: 7ab15f63 >2012-08-07 15:18:00,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:00,498 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-96) [28ff19f5] Failed in ActivateStorageDomainVDS method >2012-08-07 15:18:00,499 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-96) [28ff19f5] Error code StorageDomainDoesNotExist and error message IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 15:18:00,500 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) [28ff19f5] IrsBroker::Failed::ActivateStorageDomainVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 15:18:00,503 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (QuartzScheduler_Worker-96) [28ff19f5] FINISH, ActivateStorageDomainVDSCommand, log id: 7ab15f63 >2012-08-07 15:18:00,506 ERROR [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [28ff19f5] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) >2012-08-07 15:18:00,513 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [28ff19f5] Command org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand throw Vdc Bll exception: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to ActivateStorageDomainVDS, error = Storage domain does not exist: ('99bb665e-3421-4afb-bf70-d7b879c591b3',) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.handleVdsResult(VDSBrokerFrontendImpl.java:50) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:35) [engine-bll.jar:] > at org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand.executeCommand(ActivateStorageDomainCommand.java:67) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteWithoutTransaction(CommandBase.java:810) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:901) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1256) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:168) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:107) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.Execute(CommandBase.java:916) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.ExecuteAction(CommandBase.java:275) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:335) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:288) [engine-bll.jar:] > at sun.reflect.GeneratedMethodAccessor140.invoke(Unknown Source) [:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.1.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.1.1.Final-redhat-1] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.check(AutoRecoveryManager.java:96) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AutoRecoveryManager.onTimer(AutoRecoveryManager.java:63) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_03-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_03-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_03-icedtea] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:64) [engine-scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz-2.1.2.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz-2.1.2.jar:] > >2012-08-07 15:18:00,624 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [28ff19f5] Command [id=a7f8223e-0af8-4b01-8f70-c2c45413d1fd]: Going over compensation data. >2012-08-07 15:18:00,630 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-96) [28ff19f5] Command [id=a7f8223e-0af8-4b01-8f70-c2c45413d1fd]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.storage_pool_iso_map; snapshot: EntityStatusSnapshot [id=storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageId = 99bb665e-3421-4afb-bf70-d7b879c591b3, status=InActive]. >2012-08-07 15:18:00,663 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) [28ff19f5] Checking autorecoverable storage domains done >2012-08-07 15:18:01,863 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:02,328 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:05,245 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:06,871 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:07,427 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:10,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:11,909 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:12,378 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:15,245 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:16,932 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:17,380 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:20,257 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:21,844 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:22,394 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:25,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:27,186 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:27,320 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:30,237 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:32,180 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:32,219 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:35,215 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:36,704 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:37,540 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:40,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:41,715 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:42,225 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:44,618 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-79) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 15:18:44,620 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-79) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 15:18:44,624 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-79) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 15:18:44,627 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-79) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 15:18:45,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:46,715 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:47,225 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:50,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:51,782 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:52,226 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-24) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:55,251 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:56,674 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:18:57,218 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-4) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:00,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:01,710 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:02,228 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-18) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:05,246 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:06,708 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:07,227 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:10,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:11,735 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:12,385 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:15,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:16,813 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:17,241 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:20,260 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:21,765 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:22,268 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:25,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:26,722 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:27,208 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:30,251 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:31,708 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:32,226 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:35,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:36,719 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:37,227 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:40,250 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:41,716 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:42,233 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:44,629 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-97) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 15:19:44,631 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-97) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 15:19:44,633 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-97) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 15:19:44,634 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-97) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 15:19:45,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:46,715 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:47,246 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:50,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:51,812 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:52,233 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-21) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:55,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:56,713 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:19:57,221 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable hosts >2012-08-07 15:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Autorecovering 0 hosts >2012-08-07 15:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable hosts done >2012-08-07 15:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable storage domains >2012-08-07 15:20:00,046 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Autorecovering 1 storage domains >2012-08-07 15:20:00,060 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Autorecovering storage domains: 99bb665e-3421-4afb-bf70-d7b879c591b3 >2012-08-07 15:20:00,063 DEBUG [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-24) [3c7725c6] Permission check skipped for internal action ActivateStorageDomain. >2012-08-07 15:20:00,068 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-24) [3c7725c6] Before acquiring lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 15:20:00,072 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-24) [3c7725c6] Successed acquiring lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] succeeded >2012-08-07 15:20:00,076 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-24) [3c7725c6] Lock Acquired to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 15:20:00,113 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-24) [3c7725c6] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99bb665e-3421-4afb-bf70-d7b879c591b3 Type: Storage >2012-08-07 15:20:00,143 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-24) [3c7725c6] Before releasing a lock EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 15:20:00,144 DEBUG [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (QuartzScheduler_Worker-24) [3c7725c6] The exclusive lock for key 99bb665e-3421-4afb-bf70-d7b879c591b3STORAGE is released and lock is removed from map >2012-08-07 15:20:00,145 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-24) [3c7725c6] Lock freed to object EngineLock [exclusiveLocks= key: 99bb665e-3421-4afb-bf70-d7b879c591b3 value: STORAGE >, sharedLocks= ] >2012-08-07 15:20:00,152 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (QuartzScheduler_Worker-24) [3c7725c6] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/7/12 3:20 PM >2012-08-07 15:20:00,180 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [3c7725c6] START, ConnectStorageServerVDSCommand(vdsId = 47028088-dee6-11e1-bffa-2f8f15de3134, storagePoolId = 7a858a05-d5d9-40de-9a4e-c24b1980eb23, storageType = ISCSI, connectionList = [{ id: b2cd73d6-cacf-402b-b327-8ec359c99001, connection: 10.35.64.10 };{ id: d7f70e98-f2e9-44ba-b348-a0df8451fc68, connection: 10.35.64.10 };]), log id: 27c622 >2012-08-07 15:20:00,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:01,712 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:02,226 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:05,254 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:06,707 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:07,220 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:10,252 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:11,705 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:12,235 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:15,255 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:16,719 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:17,230 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:20,266 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:21,708 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:22,231 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:25,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:26,721 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:27,646 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:30,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:31,720 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:32,228 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:35,250 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:36,724 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:37,223 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:40,268 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:41,704 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:42,226 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:44,638 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-89) VdsLoadBalancer: Load Balancer timer entered. >2012-08-07 15:20:44,640 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-89) VdsLoadBalancer: Cluster Default skipped because no selection algorithm selected. >2012-08-07 15:20:44,643 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-89) VdsLoadBalancer: Cluster nfs31 skipped because no selection algorithm selected. >2012-08-07 15:20:44,646 DEBUG [org.ovirt.engine.core.bll.VdsLoadBalancer] (QuartzScheduler_Worker-89) VdsLoadBalancer: Cluster iscsi skipped because no selection algorithm selected. >2012-08-07 15:20:45,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:46,716 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:47,221 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:50,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:51,710 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:52,222 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:55,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:56,707 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:20:57,229 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-13) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:00,250 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:01,779 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-10) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:02,223 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:05,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:06,705 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:07,227 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:10,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-17) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:11,707 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:12,228 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:15,257 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:16,705 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:17,229 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-8) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:20,253 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:21,709 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-3) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:22,248 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-11) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:25,247 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:26,709 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-1) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:27,231 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-7) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:30,237 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:31,715 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-25) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:32,222 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-19) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:35,222 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-23) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:36,876 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-16) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:37,426 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-2) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:40,249 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-6) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:41,706 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-14) ResourceManager::searchBusinessObjects(Events:) - entered >2012-08-07 15:21:42,222 DEBUG [org.ovirt.engine.core.bll.SearchQuery] (ajp--127.0.0.1-8009-15) ResourceManager::searchBusinessObjects(Events:) - entered
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 843058
:
600296
|
602482
| 602998